Sep 18 00:26:50 devstack cinder-volume[75547]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 00:26:50 devstack cinder-volume[75547]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 00:26:50 devstack cinder-volume[75547]: we strongly recommend against using it for new projects. Sep 18 00:26:50 devstack cinder-volume[75547]: If you are already using Eventlet, we recommend migrating to a different Sep 18 00:26:50 devstack cinder-volume[75547]: framework. For more detail see Sep 18 00:26:50 devstack cinder-volume[75547]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 00:26:50 devstack cinder-volume[75547]: import eventlet # noqa Sep 18 00:26:53 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 00:26:53 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 00:26:53 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 00:26:54 devstack cinder-volume[75547]: INFO dbcounter [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Registered counter for database cinder Sep 18 00:26:54 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:26:54 devstack cinder-volume[75547]: DEBUG dbcounter [-] [75547] Writer thread running {{(pid=75547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 00:26:54 devstack cinder-volume[75547]: INFO cinder.rpc [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 00:26:54 devstack cinder-volume[75547]: INFO cinder.rpc [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 00:26:54 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:26:54 devstack cinder-volume[75547]: INFO cinder.volume.manager [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Determined volume DB was empty at startup. Sep 18 00:26:54 devstack cinder-volume[75547]: DEBUG cinder.volume.manager [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75547) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 00:26:55 devstack cinder-volume[75547]: INFO cinder.volume.manager [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 00:26:55 devstack cinder-volume[75547]: WARNING stevedore.named [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 00:26:55 devstack cinder-volume[75547]: WARNING castellan.key_manager [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 00:26:55 devstack cinder-volume[75547]: WARNING cinder.keymgr.conf_key_mgr [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG cinder.volume.drivers.lvm [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75547) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_concurrency.processutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_concurrency.processutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] CMD "cinder-rtstool verify" returned: 0 in 0.450s {{(pid=75547) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:26:55 devstack cinder-volume[75547]: INFO cinder.rpc [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 18 00:26:55 devstack cinder-volume[75547]: INFO cinder.rpc [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 18 00:26:55 devstack cinder-volume[75547]: WARNING stevedore.named [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 00:26:55 devstack cinder-volume[75547]: WARNING castellan.key_manager [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 00:26:55 devstack cinder-volume[75547]: INFO cinder.volume.manager [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_db.sqlalchemy.engines [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75547) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:26:55 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Starting 1 workers Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Started child 75699 {{(pid=75547) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Full set of CONF: {{(pid=75547) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] ******************************************************************************** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Configuration options gathered from: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] ================================================================================ {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] allow_availability_zone_fallback = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] allow_compression_on_image_upload = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] allowed_direct_url_schemes = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] api_rate_limit = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] auth_strategy = keystone {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] az_cache_duration = 3600 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_host = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_stats_polling_interval = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backup_api_class = cinder.backup.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backup_name_template = backup-%s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backup_use_same_host = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backup_use_temp_snapshot = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] chap_password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] chap_username = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_internal_tenant_project_id = 72096956b0984d78b9de72df8a41cd70 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_internal_tenant_user_id = 2107083641bc4392a7db6605fff08ac9 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75699]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cloned_volume_same_az = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cluster = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] compression_format = gzip {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] compute_api_class = cinder.compute.nova.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] config_dir = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] config_source = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] control_exchange = openstack {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] debug = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] default_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] default_group_type = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] default_volume_type = lvmdriver-1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] disk_geometry = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] driver_client_cert = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] driver_client_cert_key = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] driver_data_namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] driver_ssl_cert_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] driver_ssl_cert_verify = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] driver_use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] enable_force_upload = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] enable_new_services = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] enable_unsupported_driver = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] enabled_backends = ['lvmdriver-1'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] enforce_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] filter_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_api_insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_api_ssl_compression = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_ca_certificates_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_catalog_info = image:glance:publicURL {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_num_retries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance_request_timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] goodness_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] graceful_shutdown_timeout = 5 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] group_api_class = cinder.group.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] host = devstack {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_compress_on_upload = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_conversion_address_space_limit = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_conversion_cpu_limit = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_conversion_disable = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_introspection_address_space_limit = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_introspection_cpu_limit = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_upload_use_cinder_backend = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_upload_use_internal_tenant = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_volume_cache_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_volume_cache_max_count = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] image_volume_cache_max_size_gb = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] init_host_max_objects_retrieval = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] instance_format = [instance: %(uuid)s] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] iscsi_target_flags = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] iscsi_write_cache = on {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] iser_helper = tgtadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] iser_ip_address = 192.168.122.245 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] iser_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_color = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_config_append = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_dir = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_options = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_rotate_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_rotate_interval_type = days {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] log_rotation_type = none {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] max_age = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] max_logfile_count = 30 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] max_logfile_size_mb = 200 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] max_over_subscription_ratio = 20.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] message_reap_interval = 86400 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] message_ttl = 2592000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] migration_create_volume_timeout_secs = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] monkey_patch = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] monkey_patch_modules = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] my_ip = 192.168.122.245 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] no_snapshot_gb_quota = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] num_iser_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] num_shell_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] num_volume_device_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] nvmeof_conn_info_version = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] nvmet_ns_id = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] nvmet_port_id = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] osapi_max_limit = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] osapi_volume_ext_list = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] osapi_volume_listen = 0.0.0.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] osapi_volume_listen_port = 8776 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] osapi_volume_use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] osapi_volume_workers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] per_volume_size_limit = -1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] periodic_fuzzy_delay = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] periodic_interval = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] project_id_regex = [0-9a-f\-]+ {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] public_endpoint = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] publish_errors = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] quota_backup_gigabytes = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] quota_backups = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] quota_gigabytes = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] quota_groups = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] quota_snapshots = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] quota_volumes = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] rate_limit_burst = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] rate_limit_except_level = CRITICAL {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] rate_limit_interval = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] reinit_driver_count = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] replication_device = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] report_discard_supported = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] report_interval = 120 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] reservation_clean_interval = 86400 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] reservation_expire = 86400 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] reserved_image_namespaces = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] reserved_percentage = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] rpc_response_timeout = 120 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] run_external_periodic_tasks = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] scst_target_driver = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] scst_target_iqn_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_down_time = 720 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] shell_completion = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] snapshot_name_template = snapshot-%s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] snapshot_same_host = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] state_path = /opt/stack/data/cinder {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] storage_availability_zone = nova {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] storage_protocol = iSCSI {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] syslog_log_facility = LOG_USER {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] target_helper = lioadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] target_ip_address = 192.168.122.245 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] target_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] target_protocol = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] target_secondary_ip_addresses = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] trace_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] transfer_api_class = cinder.transfer.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] transport_url = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] until_refresh = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] use_chap_auth = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] use_default_quota_class = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] use_journal = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] use_json = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] use_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] use_stderr = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] use_syslog = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] verify_glance_signatures = enabled {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_api_class = cinder.volume.api.API {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_backend_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_clear = zero {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_clear_ionice = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_clear_size = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_copy_bps_limit = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_dd_blocksize = 1M {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_name_template = volume-%s {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_service_inithost_offload = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volume_usage_audit_period = month {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] zoning_mode = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_concurrency.disable_process_locking = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.auth_type = password {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.auth_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.cache = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.delay_auth_decision = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.http_connect_timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.include_service_catalog = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.interface = public {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcache_username = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.region_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.service_token_roles_required = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.service_type = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.token_cache_time = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.backend = dogpile.cache.null {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.backend_argument = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.backend_expiration_time = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.config_prefix = cache.oslo {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.debug_cache_backend = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.enable_retry_client = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.enable_socket_keepalive = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.expiration_time = 600 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.hashclient_retry_attempts = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.memcache_dead_retry = 300 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.memcache_pool_maxsize = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.memcache_sasl_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.proxies = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.redis_db = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.redis_sentinel_service_name = mymaster {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.redis_server = localhost:6379 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.retry_attempts = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.retry_delay = 0.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.socket_keepalive_count = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.socket_keepalive_idle = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.socket_keepalive_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.socket_timeout = 1.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.tls_allowed_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.tls_cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.tls_certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.tls_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.tls_keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cache.username = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] coordination.backend_url = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.asyncio_connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.asyncio_slave_connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.backend = sqlalchemy {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.connection_debug = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.connection_parameters = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.connection_recycle_time = 3600 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.connection_trace = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.db_inc_retry_interval = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.db_max_retries = 20 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.db_max_retry_interval = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.db_retry_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.max_overflow = 50 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.max_pool_size = 5 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.max_retries = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.mysql_wsrep_sync_wait = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.pool_timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.retry_interval = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.slave_connection = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.sqlite_synchronous = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.synchronous_reader = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] database.use_db_reconnect = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.050s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_tracing.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.connection_string = messaging:// {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.es_doc_type = notification {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.es_scroll_size = 10000 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.es_scroll_time = 2m {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.filter_error_trace = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.hmac_keys = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.sentinel_service_name = mymaster {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.socket_timeout = 0.1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.trace_requests = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler.trace_sqlalchemy = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler_jaeger.process_tags = {} {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler_jaeger.service_name_prefix = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] profiler_otlp.service_name_prefix = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.enforce_new_defaults = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.policy_default_rule = default {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.policy_file = policy.yaml {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_policy.remote_timeout = 60.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] privsep_osbrick.group = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] privsep_osbrick.helper_command = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] privsep_osbrick.user = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_sys_admin.group = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_sys_admin.helper_command = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] cinder_sys_admin.user = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.auth_type = password {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.send_service_user_token = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.tls_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] service_user.tls_min_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.auth_type = password {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.region_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.tls_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] glance.tls_min_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.backend_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.chap_password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.039s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.chap_username = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.disk_geometry = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.driver_client_cert = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.driver_client_cert_key = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.driver_data_namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.driver_use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.enable_unsupported_driver = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.extra_capabilities = {} {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.filter_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.goodness_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.iscsi_target_flags = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.iscsi_write_cache = on {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.iser_helper = tgtadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.iser_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.lvm_mirrors = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.lvm_share_target = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.lvm_type = auto {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.num_shell_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.nvmet_port_id = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.replication_device = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.report_discard_supported = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.reserved_percentage = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.scst_target_driver = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.scst_target_iqn_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.storage_protocol = iSCSI {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.target_helper = tgtadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.target_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.target_protocol = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.trace_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.unique_fqdn_network = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.use_chap_auth = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_backend_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_clear = zero {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_clear_ionice = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_clear_size = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volume_group = cinder-volumes {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_reports.file_event_handler = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_reports.log_dir = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.backend_availability_zone = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.backend_host = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.chap_password = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.chap_username = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.chiscsi_conf = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.disk_geometry = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.driver_client_cert = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.driver_data_namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.driver_use_ssl = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.extra_capabilities = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.filter_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.goodness_function = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.iser_helper = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.iser_ip_address = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.iser_port = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.iser_target_prefix = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.lvm_conf_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.lvm_mirrors = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.lvm_share_target = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.lvm_type = auto {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.num_shell_tries = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.nvmet_port_id = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.replication_device = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.report_discard_supported = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.reserved_percentage = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.scst_target_driver = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.storage_protocol = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.target_helper = lioadm {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.target_ip_address = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.target_port = 3260 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.target_protocol = iscsi {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.trace_flags = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.use_chap_auth = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_clear = zero {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_clear_size = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] lvmdriver-1.volumes_dir = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.059s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.ssl_version = {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_notifications.driver = [] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_notifications.retry = -1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] oslo_messaging_notifications.transport_url = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] key_manager.fixed_key = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.barbican_api_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.barbican_endpoint = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.barbican_endpoint_type = public {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.barbican_region_name = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.number_of_retries = 60 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.retry_delay = 1 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.send_service_user_token = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.tls_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.tls_min_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.verify_ssl = True {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican.verify_ssl_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.auth_section = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.auth_type = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.cafile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.certfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.collect_timing = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.insecure = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.keyfile = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.split_loggers = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.timeout = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.tls_ciphers = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] barbican_service_user.tls_min_version = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.approle_role_id = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.approle_secret_id = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.auth_method = approle {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.auth_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.kv_mountpoint = secret {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.kv_path = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.kv_version = 2 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.namespace = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.root_token_id = **** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.ssl_ca_crt_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.timeout = 60.0 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.token_file = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.token_role = None {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.use_ssl = False {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:26:55 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] ******************************************************************************** {{(pid=75547) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 00:26:55 devstack sudo[75706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 18 00:26:55 devstack sudo[75706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:56 devstack sudo[75706]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:56 devstack sudo[75709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:26:56 devstack sudo[75709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:56 devstack sudo[75709]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.260s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:26:56 devstack cinder-volume[75699]: INFO cinder.brick.local_dev.lvm [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:56 devstack sudo[75822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:26:56 devstack sudo[75822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:56 devstack sudo[75822]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG cinder.brick.local_dev.lvm [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75699) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 18 00:26:56 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:56 devstack sudo[75913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:26:56 devstack sudo[75913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:57 devstack sudo[75913]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.510s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:57 devstack sudo[76097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:26:57 devstack sudo[76097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:57 devstack sudo[76097]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:57 devstack sudo[76186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 18 00:26:57 devstack sudo[76186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:57 devstack sudo[76186]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.280s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:57 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:57 devstack sudo[76286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:26:57 devstack sudo[76286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:58 devstack sudo[76286]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:58 devstack sudo[76313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:26:58 devstack sudo[76313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:58 devstack sudo[76313]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.306s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:58 devstack sudo[76395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:26:58 devstack sudo[76395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:58 devstack sudo[76395]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.284s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:58 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:58 devstack sudo[76400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:26:58 devstack sudo[76400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:59 devstack sudo[76400]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.309s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:59 devstack sudo[76426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:26:59 devstack sudo[76426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:59 devstack sudo[76426]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:59 devstack cinder-volume[75699]: INFO cinder.volume.drivers.lvm [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:59 devstack sudo[76500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:26:59 devstack sudo[76500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:59 devstack sudo[76500]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Updating volume stats {{(pid=75699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:59 devstack sudo[76504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:26:59 devstack sudo[76504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:26:59 devstack sudo[76504]: pam_unix(sudo:session): session closed for user root Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:26:59 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:26:59 devstack sudo[76507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:26:59 devstack sudo[76507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:00 devstack sudo[76507]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.269s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:00 devstack sudo[76510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:27:00 devstack sudo[76510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:00 devstack sudo[76510]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:00 devstack sudo[76513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:27:00 devstack sudo[76513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:00 devstack sudo[76513]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:00 devstack cinder-volume[75699]: INFO cinder.volume.driver [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Driver hasn't implemented _init_vendor_properties() Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG cinder.volume.driver [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75699) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG oslo_db.sqlalchemy.engines [None req-de514e4a-37cd-448b-9941-57269af86495 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75699) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writer thread running {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG cinder.db.api [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Building query based on filter {{(pid=75699) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG cinder.image.image_utils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75699) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 00:27:00 devstack cinder-volume[75699]: INFO cinder.keymgr.migration [None req-91da18cd-46f3-4c58-bfc1-dec2ba5fd993 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Updating volume stats {{(pid=75699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 00:27:00 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:00 devstack sudo[76518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:27:00 devstack sudo[76518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:01 devstack sudo[76518]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.267s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:01 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:27:01 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:01 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:01 devstack sudo[76526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:27:01 devstack sudo[76526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:01 devstack sudo[76526]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:01 devstack sudo[76529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:27:01 devstack sudo[76529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:01 devstack sudo[76529]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.247s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG cinder.manager [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Notifying Schedulers of capabilities ... {{(pid=75699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:27:01 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Driver initialization completed successfully. Sep 18 00:27:01 devstack cinder-volume[75699]: INFO cinder.manager [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Initiating service 2 cleanup Sep 18 00:27:01 devstack cinder-volume[75699]: INFO cinder.manager [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Service 2 cleanup completed. Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG cinder.service [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Creating RPC server for service cinder-volume {{(pid=75699) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 00:27:01 devstack cinder-volume[75699]: DEBUG cinder.service [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75699) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 00:27:02 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Updating volume stats {{(pid=75699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:02 devstack sudo[76532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:27:02 devstack sudo[76532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:02 devstack sudo[76532]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:02 devstack sudo[76535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:27:02 devstack sudo[76535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:02 devstack sudo[76535]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:02 devstack sudo[76543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:27:02 devstack sudo[76543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:02 devstack sudo[76543]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.254s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:02 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:27:02 devstack sudo[76546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:27:02 devstack sudo[76546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:27:03 devstack sudo[76546]: pam_unix(sudo:session): session closed for user root Sep 18 00:27:03 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-de514e4a-37cd-448b-9941-57269af86495 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:27:03 devstack cinder-volume[75699]: INFO cinder.volume.manager [None req-de514e4a-37cd-448b-9941-57269af86495 None None] Driver post RPC initialization completed successfully. Sep 18 00:27:05 devstack cinder-volume[75547]: DEBUG dbcounter [-] [75547] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75547) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:27:13 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:27:13 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:27:54 devstack cinder-volume[75699]: DEBUG oslo_service.periodic_task [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running periodic task VolumeManager._thread_info {{(pid=75699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:27:54 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] thread count: 6 {{(pid=75699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:27:54 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] thread info: [<_MainThread(MainThread, started 136599660183680)>, , , , , ] {{(pid=75699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_service.periodic_task [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Updating volume stats {{(pid=75699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:28:54 devstack sudo[81776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:28:54 devstack sudo[81776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:28:54 devstack sudo[81776]: pam_unix(sudo:session): session closed for user root Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:28:54 devstack sudo[81779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:28:54 devstack sudo[81779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:28:54 devstack sudo[81779]: pam_unix(sudo:session): session closed for user root Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:28:54 devstack sudo[81782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:28:54 devstack sudo[81782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:28:54 devstack sudo[81782]: pam_unix(sudo:session): session closed for user root Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:28:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:28:54 devstack sudo[81785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:28:54 devstack sudo[81785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:28:55 devstack sudo[81785]: pam_unix(sudo:session): session closed for user root Sep 18 00:28:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:28:55 devstack cinder-volume[75699]: DEBUG cinder.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Notifying Schedulers of capabilities ... {{(pid=75699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:28:55 devstack cinder-volume[75699]: DEBUG oslo_service.periodic_task [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running periodic task VolumeManager._thread_info {{(pid=75699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:28:55 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] thread count: 6 {{(pid=75699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:28:55 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] thread info: [<_MainThread(MainThread, started 136599660183680)>, , , , , ] {{(pid=75699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:29:13 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:SELECT=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:29:13 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:UPDATE=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_service.periodic_task [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Updating volume stats {{(pid=75699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:29:54 devstack sudo[83606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:29:54 devstack sudo[83606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:29:54 devstack sudo[83606]: pam_unix(sudo:session): session closed for user root Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.271s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:29:54 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:29:54 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:29:54 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:29:54 devstack sudo[83632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:29:54 devstack sudo[83632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:29:54 devstack sudo[83632]: pam_unix(sudo:session): session closed for user root Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:29:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:29:54 devstack sudo[83646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:29:54 devstack sudo[83646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:29:55 devstack sudo[83646]: pam_unix(sudo:session): session closed for user root Sep 18 00:29:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:29:55 devstack cinder-volume[75699]: DEBUG cinder.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Notifying Schedulers of capabilities ... {{(pid=75699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_service.periodic_task [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG cinder.volume.drivers.lvm [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Updating volume stats {{(pid=75699) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:30:54 devstack sudo[84986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 18 00:30:54 devstack sudo[84986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:30:54 devstack sudo[84986]: pam_unix(sudo:session): session closed for user root Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:30:54 devstack sudo[84992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:30:54 devstack sudo[84992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:30:54 devstack sudo[84992]: pam_unix(sudo:session): session closed for user root Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:30:54 devstack sudo[84998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 18 00:30:54 devstack sudo[84998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:30:54 devstack sudo[84998]: pam_unix(sudo:session): session closed for user root Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.256s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:30:54 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:30:54 devstack sudo[85021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 18 00:30:54 devstack sudo[85021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:30:55 devstack sudo[85021]: pam_unix(sudo:session): session closed for user root Sep 18 00:30:55 devstack cinder-volume[75699]: DEBUG oslo_concurrency.processutils [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75699) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:30:55 devstack cinder-volume[75699]: DEBUG cinder.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Notifying Schedulers of capabilities ... {{(pid=75699) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:30:55 devstack cinder-volume[75699]: DEBUG oslo_service.periodic_task [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] Running periodic task VolumeManager._thread_info {{(pid=75699) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:30:55 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] thread count: 6 {{(pid=75699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:30:55 devstack cinder-volume[75699]: DEBUG cinder.volume.manager [None req-48c0f52b-76a8-41ce-b096-2732831e7c31 None None] thread info: [<_MainThread(MainThread, started 136599660183680)>, , , , , ] {{(pid=75699) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:31:13 devstack cinder-volume[75699]: DEBUG dbcounter [-] [75699] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=75699) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:31:24 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Caught SIGTERM, stopping children Sep 18 00:31:24 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Acquiring lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 00:31:24 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Acquired lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 00:31:24 devstack cinder-volume[75547]: DEBUG oslo_concurrency.lockutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Releasing lock "singleton_lock" {{(pid=75547) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 00:31:24 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Stop services. {{(pid=75547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 18 00:31:24 devstack cinder-volume[75547]: DEBUG oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Killing children. {{(pid=75547) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 18 00:31:24 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Waiting on 1 children to exit Sep 18 00:31:27 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Acquiring lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 00:31:27 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Acquired lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 00:31:27 devstack cinder-volume[75699]: DEBUG oslo_concurrency.lockutils [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Releasing lock "singleton_lock" {{(pid=75699) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 00:31:27 devstack cinder-volume[75699]: WARNING amqp [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 00:31:27 devstack cinder-volume[75699]: WARNING amqp [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 00:31:27 devstack cinder-volume[75547]: INFO oslo_service.backend._eventlet.service [None req-f1e931e8-597b-4cf9-9b8a-f75ee903de2f None None] Child 75699 exited with status 0 Sep 18 00:31:27 devstack cinder-volume[85686]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 00:31:27 devstack cinder-volume[85686]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 00:31:27 devstack cinder-volume[85686]: we strongly recommend against using it for new projects. Sep 18 00:31:27 devstack cinder-volume[85686]: If you are already using Eventlet, we recommend migrating to a different Sep 18 00:31:27 devstack cinder-volume[85686]: framework. For more detail see Sep 18 00:31:27 devstack cinder-volume[85686]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 00:31:27 devstack cinder-volume[85686]: import eventlet # noqa Sep 18 00:31:29 devstack cinder-volume[85686]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 00:31:29 devstack cinder-volume[85686]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 00:31:29 devstack cinder-volume[85686]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 00:31:30 devstack cinder-volume[85686]: INFO dbcounter [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Registered counter for database cinder Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_db.sqlalchemy.engines [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85686) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG dbcounter [-] [85686] Writer thread running {{(pid=85686) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 00:31:30 devstack cinder-volume[85686]: INFO cinder.rpc [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 00:31:30 devstack cinder-volume[85686]: INFO cinder.rpc [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_db.sqlalchemy.engines [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85686) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:30 devstack cinder-volume[85686]: INFO cinder.volume.manager [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Determined volume DB was empty at startup. Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG cinder.volume.manager [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85686) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 00:31:30 devstack cinder-volume[85686]: INFO cinder.volume.manager [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 18 00:31:30 devstack cinder-volume[85686]: WARNING stevedore.named [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 00:31:30 devstack cinder-volume[85686]: WARNING castellan.key_manager [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 00:31:30 devstack cinder-volume[85686]: WARNING cinder.keymgr.conf_key_mgr [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 00:31:30 devstack cinder-volume[85686]: INFO cinder.volume.manager [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_db.sqlalchemy.engines [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85686) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:30 devstack cinder-volume[85686]: INFO oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Starting 1 workers Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Started child 85900 {{(pid=85686) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Full set of CONF: {{(pid=85686) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] ******************************************************************************** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Configuration options gathered from: {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 00:31:30 devstack cinder-volume[85900]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] ================================================================================ {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] allow_availability_zone_fallback = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] allow_compression_on_image_upload = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] allowed_direct_url_schemes = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] api_rate_limit = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] auth_strategy = keystone {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_availability_zone = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_host = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_stats_polling_interval = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backup_api_class = cinder.backup.api.API {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backup_name_template = backup-%s {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backup_use_same_host = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backup_use_temp_snapshot = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] chap_password = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] chap_username = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_internal_tenant_project_id = 72096956b0984d78b9de72df8a41cd70 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_internal_tenant_user_id = 2107083641bc4392a7db6605fff08ac9 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cluster = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] compression_format = gzip {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] compute_api_class = cinder.compute.nova.API {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] config_dir = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] config_source = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] control_exchange = openstack {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] debug = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] default_availability_zone = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] default_group_type = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] default_volume_type = QuobyteHD {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] disk_geometry = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] driver_client_cert = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] driver_client_cert_key = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] driver_data_namespace = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] driver_ssl_cert_path = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] driver_ssl_cert_verify = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] driver_use_ssl = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] enable_new_services = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] enable_unsupported_driver = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] enabled_backends = ['QuobyteHD'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] enforce_multipath_for_image_xfer = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] filter_function = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_api_insecure = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_api_ssl_compression = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_ca_certificates_file = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_catalog_info = image:glance:publicURL {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_num_retries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance_request_timeout = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] goodness_function = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] graceful_shutdown_timeout = 5 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] group_api_class = cinder.group.api.API {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] host = devstack {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_compress_on_upload = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_conversion_address_space_limit = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_conversion_cpu_limit = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_conversion_disable = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_introspection_address_space_limit = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_introspection_cpu_limit = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_upload_use_cinder_backend = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_upload_use_internal_tenant = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_volume_cache_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_volume_cache_max_count = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] image_volume_cache_max_size_gb = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] init_host_max_objects_retrieval = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] instance_format = [instance: %(uuid)s] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] iscsi_target_flags = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] iscsi_write_cache = on {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] iser_helper = tgtadm {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] iser_ip_address = 192.168.122.245 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] iser_port = 3260 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_color = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_config_append = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_dir = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_file = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_options = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_rotate_interval = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_rotate_interval_type = days {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] log_rotation_type = none {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] max_age = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] max_logfile_count = 30 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] max_logfile_size_mb = 200 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] max_over_subscription_ratio = 20.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] message_reap_interval = 86400 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] message_ttl = 2592000 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] migration_create_volume_timeout_secs = 300 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] monkey_patch = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] monkey_patch_modules = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] my_ip = 192.168.122.245 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] no_snapshot_gb_quota = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] num_iser_scan_tries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] num_shell_tries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] num_volume_device_scan_tries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85900]: INFO cinder.volume.manager [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] nvmeof_conn_info_version = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] nvmet_ns_id = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] nvmet_port_id = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] osapi_max_limit = 1000 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] osapi_volume_ext_list = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] osapi_volume_listen = 0.0.0.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] osapi_volume_listen_port = 8776 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.remotefs [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85900) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] osapi_volume_use_ssl = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] osapi_volume_workers = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] per_volume_size_limit = -1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] periodic_fuzzy_delay = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] periodic_interval = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] project_id_regex = [0-9a-f\-]+ {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] public_endpoint = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] publish_errors = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] quota_backup_gigabytes = 1000 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] quota_backups = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] quota_gigabytes = 1000 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] quota_groups = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] quota_snapshots = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] quota_volumes = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] rate_limit_burst = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] rate_limit_except_level = CRITICAL {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] rate_limit_interval = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] reinit_driver_count = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] replication_device = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] report_discard_supported = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] report_interval = 120 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] reservation_clean_interval = 86400 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] reservation_expire = 86400 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] reserved_image_namespaces = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] reserved_percentage = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] rpc_response_timeout = 120 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] run_external_periodic_tasks = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] scst_target_driver = iscsi {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] scst_target_iqn_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_down_time = 720 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] shell_completion = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] snapshot_name_template = snapshot-%s {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] split_loggers = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] state_path = /opt/stack/data/cinder {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] storage_availability_zone = nova {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] storage_protocol = iSCSI {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] syslog_log_facility = LOG_USER {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] target_helper = lioadm {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] target_ip_address = 192.168.122.245 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] target_port = 3260 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] target_protocol = iscsi {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] target_secondary_ip_addresses = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] trace_flags = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] transfer_api_class = cinder.transfer.api.API {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] transport_url = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] until_refresh = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] use_chap_auth = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:30 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] use_default_quota_class = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] use_journal = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] use_json = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] use_multipath_for_image_xfer = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] use_stderr = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] use_syslog = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] verify_glance_signatures = enabled {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_api_class = cinder.volume.api.API {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_backend_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_clear = zero {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_clear_ionice = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_clear_size = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_copy_bps_limit = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_dd_blocksize = 1M {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_name_template = volume-%s {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_service_inithost_offload = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volume_usage_audit_period = month {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] zoning_mode = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_concurrency.disable_process_locking = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.auth_section = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.auth_type = password {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.auth_version = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.cache = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.delay_auth_decision = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.http_connect_timeout = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.include_service_catalog = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.insecure = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.interface = public {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_password = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcache_username = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.region_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.service_token_roles_required = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.service_type = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.token_cache_time = 300 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.backend = dogpile.cache.null {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.backend_argument = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.backend_expiration_time = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.config_prefix = cache.oslo {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.debug_cache_backend = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.enable_retry_client = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.enable_socket_keepalive = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.expiration_time = 600 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.hashclient_retry_attempts = 2 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.memcache_dead_retry = 300 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.memcache_pool_maxsize = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.memcache_sasl_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.password = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.proxies = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.redis_db = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.redis_sentinel_service_name = mymaster {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.redis_server = localhost:6379 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.retry_attempts = 2 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.retry_delay = 0.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.socket_keepalive_count = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.socket_keepalive_idle = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.socket_keepalive_interval = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.socket_timeout = 1.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.tls_allowed_ciphers = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.tls_cafile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.tls_certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.tls_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.tls_keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cache.username = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] coordination.backend_url = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.asyncio_connection = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85900) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 18 00:31:31 devstack cinder-volume[85900]: WARNING cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 18 00:31:31 devstack cinder-volume[85900]: WARNING cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Running cmd (subprocess): mount.quobyte {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.asyncio_slave_connection = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.backend = sqlalchemy {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.connection = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.connection_debug = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.connection_parameters = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.connection_recycle_time = 3600 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.connection_trace = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.db_inc_retry_interval = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.db_max_retries = 20 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.db_max_retry_interval = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.db_retry_interval = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.max_overflow = 50 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.max_pool_size = 5 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.max_retries = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.mysql_wsrep_sync_wait = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.pool_timeout = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.retry_interval = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.slave_connection = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.sqlite_synchronous = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.synchronous_reader = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] database.use_db_reconnect = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_tracing.insecure = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.connection_string = messaging:// {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.es_doc_type = notification {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.es_scroll_size = 10000 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.es_scroll_time = 2m {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.filter_error_trace = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.hmac_keys = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.sentinel_service_name = mymaster {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.socket_timeout = 0.1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.trace_requests = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler.trace_sqlalchemy = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler_jaeger.process_tags = {} {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler_jaeger.service_name_prefix = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] profiler_otlp.service_name_prefix = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.enforce_new_defaults = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.policy_default_rule = default {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.policy_file = policy.yaml {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_policy.remote_timeout = 60.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] privsep_osbrick.group = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] privsep_osbrick.helper_command = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] privsep_osbrick.user = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_sys_admin.group = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_sys_admin.helper_command = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] cinder_sys_admin.user = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.auth_section = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.auth_type = password {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.cafile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.collect_timing = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.insecure = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.send_service_user_token = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.split_loggers = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.timeout = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.tls_ciphers = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] service_user.tls_min_version = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.auth_section = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.auth_type = password {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.collect_timing = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.insecure = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.region_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.split_loggers = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.timeout = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.tls_ciphers = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] glance.tls_min_version = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.backend_availability_zone = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.chap_password = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.chap_username = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.disk_geometry = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.driver_client_cert = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.driver_client_cert_key = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.driver_data_namespace = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.driver_use_ssl = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.enable_unsupported_driver = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.extra_capabilities = {} {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.filter_function = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.goodness_function = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.iscsi_target_flags = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.iscsi_write_cache = on {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.iser_helper = tgtadm {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.iser_port = 3260 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_host = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_login = admin {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_mount_options = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_password = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_private_key = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_share_path = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_ssh_port = 22 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.num_shell_tries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.nvmet_port_id = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.quobyte_client_cfg = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.quobyte_volume_url = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.replication_device = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.report_discard_supported = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.reserved_percentage = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.scst_target_driver = iscsi {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.scst_target_iqn_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.storage_protocol = iSCSI {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.target_helper = tgtadm {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.target_port = 3260 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.target_protocol = iscsi {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.trace_flags = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.unique_fqdn_network = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.use_chap_auth = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_backend_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_clear = zero {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_clear_ionice = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_clear_size = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_reports.file_event_handler = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_reports.log_dir = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.backend_availability_zone = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.backend_host = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.chap_password = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.chap_username = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.chiscsi_conf = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack quobyte-client[85901]: Reading configuration file: /etc/quobyte/client.cfg Sep 18 00:31:31 devstack quobyte-client[85901]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.disk_geometry = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.driver_client_cert = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.driver_client_cert_key = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] CMD "mount.quobyte" returned: 1 in 0.120s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=85900) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.driver_data_namespace = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85900]: INFO cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa ... Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.driver_use_ssl = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb -c /etc/quobyte/client-cinder.cfg {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.extra_capabilities = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.filter_function = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.goodness_function = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.iscsi_target_flags = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.iscsi_write_cache = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.iser_helper = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.iser_ip_address = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.iser_port = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.iser_target_prefix = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_host = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_login = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_mount_options = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_password = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_private_key = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_share_path = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_ssh_port = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.num_shell_tries = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nvmet_ns_id = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.nvmet_port_id = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack sudo[85906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb -c /etc/quobyte/client-cinder.cfg Sep 18 00:31:31 devstack sudo[85906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.replication_device = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.report_discard_supported = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.reserved_percentage = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.scst_target_driver = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.storage_protocol = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.target_helper = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.target_ip_address = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.target_port = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.target_prefix = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.target_protocol = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.trace_flags = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.unique_fqdn_network = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.use_chap_auth = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_clear = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_clear_ionice = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_clear_size = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] QuobyteHD.volumes_dir = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.ssl = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.ssl_version = {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_notifications.driver = [] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_notifications.retry = -1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] oslo_messaging_notifications.transport_url = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] key_manager.fixed_key = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.barbican_api_version = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.barbican_endpoint = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.barbican_endpoint_type = public {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.barbican_region_name = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.cafile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.collect_timing = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.insecure = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.number_of_retries = 60 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.retry_delay = 1 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.send_service_user_token = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.split_loggers = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.timeout = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.tls_ciphers = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.tls_min_version = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.verify_ssl = True {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican.verify_ssl_path = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.auth_section = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.auth_type = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.cafile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.certfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.collect_timing = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.insecure = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.keyfile = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.split_loggers = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.timeout = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.tls_ciphers = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] barbican_service_user.tls_min_version = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.approle_role_id = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.approle_secret_id = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.auth_method = approle {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.auth_path = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.kv_mountpoint = secret {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.kv_path = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.kv_version = 2 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.namespace = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.root_token_id = **** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.ssl_ca_crt_file = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.timeout = 60.0 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.token_file = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.token_role = None {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.use_ssl = False {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:31 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] ******************************************************************************** {{(pid=85686) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 00:31:31 devstack sudo[85906]: pam_unix(sudo:session): session closed for user root Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.415s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:31 devstack cinder-volume[85900]: INFO cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa succeeded Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=85900) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.445s {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:31 devstack sudo[86005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:31:31 devstack sudo[86005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:31:31 devstack sudo[86005]: pam_unix(sudo:session): session closed for user root Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.242s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:31 devstack cinder-volume[85900]: INFO cinder.volume.driver [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Driver hasn't implemented _init_vendor_properties() Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG cinder.volume.driver [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.76655960083, 'free_capacity_gb': 1775.76655960083, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85900) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG oslo_db.sqlalchemy.engines [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85900) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:31 devstack cinder-volume[85900]: DEBUG dbcounter [-] [85900] Writer thread running {{(pid=85900) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.db.api [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Building query based on filter {{(pid=85900) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.image.image_utils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85900) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 00:31:32 devstack cinder-volume[85900]: INFO cinder.keymgr.migration [None req-7674b939-4aab-4832-b507-e115ca2bfc4a None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=85900) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=85900) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:32 devstack sudo[86008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:31:32 devstack sudo[86008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:31:32 devstack sudo[86008]: pam_unix(sudo:session): session closed for user root Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.240s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.manager [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Notifying Schedulers of capabilities ... {{(pid=85900) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:31:32 devstack cinder-volume[85900]: INFO cinder.volume.manager [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Driver initialization completed successfully. Sep 18 00:31:32 devstack cinder-volume[85900]: INFO cinder.manager [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Initiating service 3 cleanup Sep 18 00:31:32 devstack cinder-volume[85900]: INFO cinder.manager [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Service 3 cleanup completed. Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.service [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Creating RPC server for service cinder-volume {{(pid=85900) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.service [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85900) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 00:31:32 devstack cinder-volume[85900]: INFO cinder.volume.manager [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=85900) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG cinder.volume.drivers.quobyte [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=85900) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=85900) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:32 devstack sudo[86012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:31:32 devstack sudo[86012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:31:32 devstack sudo[86012]: pam_unix(sudo:session): session closed for user root Sep 18 00:31:32 devstack cinder-volume[85900]: DEBUG oslo_concurrency.processutils [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.250s {{(pid=85900) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:32 devstack cinder-volume[85900]: INFO cinder.volume.manager [None req-82c69982-46a9-42da-9d72-a36dc6b82af9 None None] Driver post RPC initialization completed successfully. Sep 18 00:31:36 devstack cinder-volume[85686]: INFO oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Caught SIGTERM, stopping children Sep 18 00:31:36 devstack cinder-volume[85686]: DEBUG oslo_concurrency.lockutils [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Acquiring lock "singleton_lock" {{(pid=85686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 00:31:36 devstack cinder-volume[85686]: DEBUG oslo_concurrency.lockutils [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Acquired lock "singleton_lock" {{(pid=85686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 00:31:36 devstack cinder-volume[85686]: DEBUG oslo_concurrency.lockutils [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Releasing lock "singleton_lock" {{(pid=85686) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 00:31:36 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Stop services. {{(pid=85686) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 18 00:31:36 devstack cinder-volume[85686]: DEBUG oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Killing children. {{(pid=85686) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 18 00:31:36 devstack cinder-volume[85686]: INFO oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Waiting on 1 children to exit Sep 18 00:31:40 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Acquiring lock "singleton_lock" {{(pid=85900) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 00:31:40 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Acquired lock "singleton_lock" {{(pid=85900) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 00:31:40 devstack cinder-volume[85900]: DEBUG oslo_concurrency.lockutils [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Releasing lock "singleton_lock" {{(pid=85900) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 00:31:40 devstack cinder-volume[85900]: WARNING amqp [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 00:31:40 devstack cinder-volume[85900]: WARNING amqp [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 18 00:31:40 devstack cinder-volume[85686]: INFO oslo_service.backend._eventlet.service [None req-2ef585fd-688d-4b4f-8c85-1ec42bd9056e None None] Child 85900 exited with status 0 Sep 18 00:31:41 devstack cinder-volume[86223]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 18 00:31:41 devstack cinder-volume[86223]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 00:31:41 devstack cinder-volume[86223]: we strongly recommend against using it for new projects. Sep 18 00:31:41 devstack cinder-volume[86223]: If you are already using Eventlet, we recommend migrating to a different Sep 18 00:31:41 devstack cinder-volume[86223]: framework. For more detail see Sep 18 00:31:41 devstack cinder-volume[86223]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 00:31:41 devstack cinder-volume[86223]: import eventlet # noqa Sep 18 00:31:43 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 18 00:31:43 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 18 00:31:43 devstack cinder-volume[86223]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86223) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 18 00:31:44 devstack cinder-volume[86223]: INFO dbcounter [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Registered counter for database cinder Sep 18 00:31:44 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:44 devstack cinder-volume[86223]: DEBUG dbcounter [-] [86223] Writer thread running {{(pid=86223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 00:31:44 devstack cinder-volume[86223]: INFO cinder.rpc [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 18 00:31:44 devstack cinder-volume[86223]: INFO cinder.rpc [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 18 00:31:44 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:44 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Determined volume DB was empty at startup. Sep 18 00:31:44 devstack cinder-volume[86223]: DEBUG cinder.volume.manager [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86223) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 18 00:31:44 devstack cinder-volume[86223]: WARNING stevedore.named [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 18 00:31:44 devstack cinder-volume[86223]: WARNING castellan.key_manager [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 00:31:44 devstack cinder-volume[86223]: WARNING cinder.keymgr.conf_key_mgr [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 18 00:31:44 devstack cinder-volume[86223]: INFO cinder.volume.manager [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_db.sqlalchemy.engines [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86223) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:45 devstack cinder-volume[86223]: INFO oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Starting 1 workers Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Started child 86526 {{(pid=86223) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Full set of CONF: {{(pid=86223) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] Configuration options gathered from: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] ================================================================================ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] allow_availability_zone_fallback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] allow_compression_on_image_upload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] allowed_direct_url_schemes = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] api_rate_limit = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] auth_strategy = keystone {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_stats_polling_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backup_api_class = cinder.backup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backup_name_template = backup-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backup_use_same_host = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86526]: INFO cinder.service [-] Starting cinder-volume node (version 29.1.0) Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_internal_tenant_project_id = 72096956b0984d78b9de72df8a41cd70 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_internal_tenant_user_id = 2107083641bc4392a7db6605fff08ac9 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cluster = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] compression_format = gzip {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] compute_api_class = cinder.compute.nova.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] config_dir = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] config_source = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] control_exchange = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] debug = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] default_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] default_group_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] default_volume_type = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] enable_new_services = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] enabled_backends = ['QuobyteHD'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_api_insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_api_servers = ['http://192.168.122.245/image'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_api_ssl_compression = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_ca_certificates_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_catalog_info = image:glance:publicURL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_num_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance_request_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] graceful_shutdown_timeout = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] group_api_class = cinder.group.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] host = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_compress_on_upload = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_conversion_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_conversion_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_conversion_disable = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_introspection_address_space_limit = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_introspection_cpu_limit = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] init_host_max_objects_retrieval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] instance_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] iser_ip_address = 192.168.122.245 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_color = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_config_append = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_options = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_rotate_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_rotate_interval_type = days {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] log_rotation_type = none {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] max_age = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] max_logfile_count = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] max_logfile_size_mb = 200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] message_reap_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] message_ttl = 2592000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] migration_create_volume_timeout_secs = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] monkey_patch = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] monkey_patch_modules = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] my_ip = 192.168.122.245 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] no_snapshot_gb_quota = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] osapi_max_limit = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] osapi_volume_ext_list = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] osapi_volume_listen = 0.0.0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] osapi_volume_listen_port = 8776 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] osapi_volume_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] osapi_volume_workers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] per_volume_size_limit = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] periodic_fuzzy_delay = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] periodic_interval = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] project_id_regex = [0-9a-f\-]+ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] public_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] publish_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] quota_backup_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86526) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] quota_backups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] quota_gigabytes = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] quota_groups = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] quota_snapshots = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] quota_volumes = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] rate_limit_burst = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] rate_limit_except_level = CRITICAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] rate_limit_interval = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] reinit_driver_count = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] report_interval = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] reservation_clean_interval = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] reservation_expire = 86400 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] reserved_image_namespaces = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] rpc_response_timeout = 120 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] run_external_periodic_tasks = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_down_time = 720 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] shell_completion = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] snapshot_name_template = snapshot-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] state_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] storage_availability_zone = nova {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] syslog_log_facility = LOG_USER {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] target_helper = lioadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] target_ip_address = 192.168.122.245 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] transfer_api_class = cinder.transfer.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] until_refresh = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] use_default_quota_class = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] use_journal = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] use_json = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] use_stderr = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] use_syslog = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] verify_glance_signatures = enabled {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_api_class = cinder.volume.api.API {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_name_template = volume-%s {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_service_inithost_offload = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volume_usage_audit_period = month {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] zoning_mode = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_concurrency.disable_process_locking = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.auth_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.delay_auth_decision = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.http_connect_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.include_service_catalog = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.interface = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcache_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.service_token_roles_required = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.service_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.token_cache_time = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.245/identity {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.backend = dogpile.cache.null {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.backend_argument = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.backend_expiration_time = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.config_prefix = cache.oslo {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.debug_cache_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.enable_retry_client = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.enable_socket_keepalive = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.expiration_time = 600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.hashclient_retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.memcache_dead_retry = 300 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.memcache_pool_maxsize = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.memcache_sasl_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.proxies = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.redis_db = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.redis_sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.redis_server = localhost:6379 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.retry_attempts = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.retry_delay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.socket_keepalive_count = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.socket_keepalive_idle = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.socket_keepalive_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.socket_timeout = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.tls_allowed_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.tls_cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.tls_certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.tls_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.tls_keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cache.username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] coordination.backend_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.asyncio_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.asyncio_slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.backend = sqlalchemy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.connection_debug = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.connection_parameters = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.connection_recycle_time = 3600 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.connection_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.db_inc_retry_interval = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.db_max_retries = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.db_max_retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.db_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.max_overflow = 50 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.max_pool_size = 5 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.max_retries = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.mysql_wsrep_sync_wait = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.pool_timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.retry_interval = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.slave_connection = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.sqlite_synchronous = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.synchronous_reader = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] database.use_db_reconnect = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_tracing.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.connection_string = messaging:// {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.es_doc_type = notification {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.es_scroll_size = 10000 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.es_scroll_time = 2m {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.filter_error_trace = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.hmac_keys = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.sentinel_service_name = mymaster {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.socket_timeout = 0.1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.trace_requests = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler.trace_sqlalchemy = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler_jaeger.process_tags = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler_jaeger.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] profiler_otlp.service_name_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.enforce_new_defaults = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.policy_default_rule = default {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.policy_file = policy.yaml {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_policy.remote_timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] privsep_osbrick.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] privsep_osbrick.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] privsep_osbrick.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_sys_admin.group = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_sys_admin.helper_command = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86526) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] cinder_sys_admin.user = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Running cmd (subprocess): mount.quobyte {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.send_service_user_token = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] service_user.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.auth_type = password {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] glance.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.chap_username = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.driver_use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.enable_unsupported_driver = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.extra_capabilities = {} {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.iscsi_target_flags = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.iscsi_write_cache = on {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.iser_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.iser_ip_address = 192.168.122.245 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.iser_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_host = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_login = admin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_private_key = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_share_path = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_ssh_port = 22 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.num_shell_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.nvmet_port_id = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.quobyte_client_cfg = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.quobyte_volume_url = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.report_discard_supported = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.reserved_percentage = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.scst_target_driver = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.storage_protocol = iSCSI {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.target_helper = tgtadm {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.target_ip_address = 192.168.122.245 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.target_port = 3260 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.target_protocol = iscsi {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.unique_fqdn_network = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.use_chap_auth = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_backend_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_clear = zero {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_clear_size = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_reports.file_event_handler = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_reports.log_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.backend_availability_zone = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.backend_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.chap_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.chap_username = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.chiscsi_conf = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.disk_geometry = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.driver_client_cert = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.driver_client_cert_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.driver_data_namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.driver_use_ssl = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.extra_capabilities = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.filter_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.goodness_function = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.iscsi_target_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.iscsi_write_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.iser_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.iser_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.iser_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.iser_target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_host = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_login = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_mount_options = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_password = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_private_key = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_share_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_ssh_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.num_shell_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nvmet_ns_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.nvmet_port_id = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] CMD "mount.quobyte" returned: 1 in 0.074s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.replication_device = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.report_discard_supported = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.reserved_percentage = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.scst_target_driver = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.storage_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.target_helper = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.target_ip_address = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.target_port = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.target_prefix = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.target_protocol = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.trace_flags = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.unique_fqdn_network = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.use_chap_auth = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_clear = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_clear_ionice = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_clear_size = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] QuobyteHD.volumes_dir = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.ssl_version = {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_notifications.driver = [] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_notifications.retry = -1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] oslo_messaging_notifications.transport_url = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] key_manager.fixed_key = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.barbican_api_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.barbican_endpoint = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.barbican_endpoint_type = public {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.barbican_region_name = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.number_of_retries = 60 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.retry_delay = 1 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.send_service_user_token = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.verify_ssl = True {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican.verify_ssl_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.auth_section = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.auth_type = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.cafile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.certfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.collect_timing = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.insecure = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.keyfile = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.split_loggers = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.timeout = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.tls_ciphers = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] barbican_service_user.tls_min_version = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.approle_role_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.approle_secret_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.auth_method = approle {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.auth_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.kv_mountpoint = secret {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.kv_path = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.kv_version = 2 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.namespace = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.root_token_id = **** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.ssl_ca_crt_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.timeout = 60.0 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.token_file = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.token_role = None {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.use_ssl = False {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack sudo[86536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 18 00:31:45 devstack cinder-volume[86223]: DEBUG oslo_service.backend._eventlet.service [None req-73cb78be-55fd-4291-ab7e-71e0e51edfb5 None None] ******************************************************************************** {{(pid=86223) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 18 00:31:45 devstack sudo[86536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:31:45 devstack sudo[86536]: pam_unix(sudo:session): session closed for user root Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:45 devstack cinder-volume[86526]: INFO cinder.volume.driver [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Driver hasn't implemented _init_vendor_properties() Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.volume.driver [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.76655960083, 'free_capacity_gb': 1775.76655960083, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86526) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_db.sqlalchemy.engines [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86526) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writer thread running {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.db.api [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Building query based on filter {{(pid=86526) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86526) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:45 devstack cinder-volume[86526]: INFO cinder.keymgr.migration [None req-142c6ab3-7746-4f78-a312-d52de3823308 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 18 00:31:45 devstack sudo[86547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:31:45 devstack sudo[86547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:31:45 devstack sudo[86547]: pam_unix(sudo:session): session closed for user root Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.234s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:45 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:31:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Driver initialization completed successfully. Sep 18 00:31:45 devstack cinder-volume[86526]: INFO cinder.manager [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Initiating service 3 cleanup Sep 18 00:31:46 devstack cinder-volume[86526]: INFO cinder.manager [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Service 3 cleanup completed. Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG cinder.service [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Creating RPC server for service cinder-volume {{(pid=86526) start /opt/stack/cinder/cinder/service.py:231}} Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG cinder.service [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86526) start /opt/stack/cinder/cinder/service.py:237}} Sep 18 00:31:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:31:46 devstack sudo[86558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:31:46 devstack sudo[86558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:31:46 devstack sudo[86558]: pam_unix(sudo:session): session closed for user root Sep 18 00:31:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.234s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:31:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c1986635-dc88-4bb4-80f1-ab8f95b2d7b7 None None] Driver post RPC initialization completed successfully. Sep 18 00:31:55 devstack cinder-volume[86223]: DEBUG dbcounter [-] [86223] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86223) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:31:55 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:31:56 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=3 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:32:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:32:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 6 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:32:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Flow 'volume_create_manager' (7b6a2b44-05b5-4bd1-8ea9-21cbb2ded05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ff6846-191f-4b14-b79c-d5ad072a5ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1ff6846-191f-4b14-b79c-d5ad072a5ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-563520180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42973951-19f0-4ff3-a248-105153ed56c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb4baa29a744a1299d6ffe021aee43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:32:43Z,use_quota=True,user_id='2890c61491914b8f934c5d566766496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb2dcc3-cd2b-418e-b985-f8c8fcea6aed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb2dcc3-cd2b-418e-b985-f8c8fcea6aed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f51bd6f-0255-4dac-8ad5-55130b43c995) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f51bd6f-0255-4dac-8ad5-55130b43c995) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42973951-19f0-4ff3-a248-105153ed56c5', 'volume_name': 'volume-42973951-19f0-4ff3-a248-105153ed56c5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37d3679-3823-4496-972e-65e32512b5fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a37d3679-3823-4496-972e-65e32512b5fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f442208a-2cca-427d-bff7-98467b6a503e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:43 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Volume 42973951-19f0-4ff3-a248-105153ed56c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42973951-19f0-4ff3-a248-105153ed56c5', 'volume_size': 1} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-563520180',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42973951-19f0-4ff3-a248-105153ed56c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0eb4baa29a744a1299d6ffe021aee43d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:32:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:32:43Z,use_quota=True,user_id='2890c61491914b8f934c5d566766496c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Creating volume 42973951-19f0-4ff3-a248-105153ed56c5 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:32:43 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:32:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:43 devstack sudo[87228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 1073741824 Sep 18 00:32:43 devstack sudo[87228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c21876ee-2fa0-44a9-a86e-10be5913c93a tempest-GroupSnapshotsV319Test-113019574 None] Group tempest-GroupSnapshotsV319Test-Group-1510585052: creating Sep 18 00:32:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c21876ee-2fa0-44a9-a86e-10be5913c93a tempest-GroupSnapshotsV319Test-113019574 None] Group tempest-GroupSnapshotsV319Test-Group-1510585052: created successfully Sep 18 00:32:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c21876ee-2fa0-44a9-a86e-10be5913c93a tempest-GroupSnapshotsV319Test-113019574 None] Create group completed successfully. Sep 18 00:32:44 devstack sudo[87228]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 1073741824" returned: 0 in 1.043s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:44 devstack sudo[87548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 Sep 18 00:32:44 devstack sudo[87548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:44 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:32:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Flow 'volume_create_manager' (5484f52e-05de-452e-8dac-1ea985d30fcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b38f362-a332-4057-92fa-23426be39da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b38f362-a332-4057-92fa-23426be39da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-605052965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef1d659d-0fdc-4dd7-a904-e7bea4c337ae,host='devstack@QuobyteHD#QuobyteHD',id=830ae9e6-7705-4184-a90b-a3bbc23da2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08c495216bf4030b76762c26d7493f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:32:45Z,use_quota=True,user_id='886630315bc3416d930974faf17bfb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8bae0c-f237-4386-9399-8d2dcaf6093c),volume_type_id=8f8bae0c-f237-4386-9399-8d2dcaf6093c)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c582c8-c7d1-4fff-995c-3aab5a9b2421) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42c582c8-c7d1-4fff-995c-3aab5a9b2421) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066bfb22-f52b-4911-b25d-c7a8200d1907) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (066bfb22-f52b-4911-b25d-c7a8200d1907) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '830ae9e6-7705-4184-a90b-a3bbc23da2b5', 'volume_name': 'volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455b42b7-73f2-42c2-904c-ee7fb35d39c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:45 devstack sudo[87548]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (455b42b7-73f2-42c2-904c-ee7fb35d39c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013f0a0e-d313-4a06-8c66-42831e787e15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:45 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Volume 830ae9e6-7705-4184-a90b-a3bbc23da2b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5', 'volume_size': 1} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5" returned: 0 in 0.664s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] <== create_volume: return (1853ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=ef1d659d-0fdc-4dd7-a904-e7bea4c337ae,created_at=2026-09-17T22:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-605052965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=ef1d659d-0fdc-4dd7-a904-e7bea4c337ae,host='devstack@QuobyteHD#QuobyteHD',id=830ae9e6-7705-4184-a90b-a3bbc23da2b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e08c495216bf4030b76762c26d7493f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:32:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:32:45Z,use_quota=True,user_id='886630315bc3416d930974faf17bfb31',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8f8bae0c-f237-4386-9399-8d2dcaf6093c),volume_type_id=8f8bae0c-f237-4386-9399-8d2dcaf6093c)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Creating volume 830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:32:45 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:45 devstack sudo[87551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 1073741824 Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f442208a-2cca-427d-bff7-98467b6a503e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42973951-19f0-4ff3-a248-105153ed56c5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:45 devstack sudo[87551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f8f7eb-61f4-424c-bf53-fc6609b1bc40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:45 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Volume volume-42973951-19f0-4ff3-a248-105153ed56c5 (42973951-19f0-4ff3-a248-105153ed56c5): created successfully Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (94f8f7eb-61f4-424c-bf53-fc6609b1bc40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Flow 'volume_create_manager' (7b6a2b44-05b5-4bd1-8ea9-21cbb2ded05f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:32:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4e49ea0a-3045-43a7-8e03-e62a2f3da2c7 tempest-DeleteServersTestJSON-217444698 None] Created volume successfully. Sep 18 00:32:45 devstack sudo[87551]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 1073741824" returned: 0 in 0.624s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:45 devstack sudo[87557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 Sep 18 00:32:45 devstack sudo[87557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:46 devstack sudo[87557]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5" returned: 0 in 0.607s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] <== create_volume: return (1305ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:32:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.308s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:32:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (013f0a0e-d313-4a06-8c66-42831e787e15) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872de9a1-4129-4fa0-b169-acc853e7b793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:32:46 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Volume volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 (830ae9e6-7705-4184-a90b-a3bbc23da2b5): created successfully Sep 18 00:32:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (872de9a1-4129-4fa0-b169-acc853e7b793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:32:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Flow 'volume_create_manager' (5484f52e-05de-452e-8dac-1ea985d30fcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:32:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f84acf8e-6024-4593-b1b3-ab437b7fe28b tempest-GroupSnapshotsV319Test-113019574 None] Created volume successfully. Sep 18 00:32:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] GroupSnapshot b730af8f-347e-4e64-9a60-9a3826330144: creating. Sep 18 00:32:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Group snapshot b730af8f-347e-4e64-9a60-9a3826330144: creating. {{(pid=86526) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 00:32:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:32:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:32:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Creating offline snapshot b32391d7-5f9c-4c73-8ecc-799f17857ccb of volume 830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:32:48 devstack cinder-volume[86526]: INFO oslo.privsep.daemon [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpzv16gbqm/privsep.sock'] Sep 18 00:32:48 devstack sudo[87592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpzv16gbqm/privsep.sock Sep 18 00:32:48 devstack sudo[87592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: Sep 18 00:32:49 devstack cinder-volume[86526]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 18 00:32:50 devstack cinder-volume[86526]: WARNING py.warnings [req-2b69e52a-9924-429d-87d9-6b7f296eccd6 req-07697e5f-1981-414c-89be-b38cb59f89b0 tempest-DeleteServersTestJSON-217444698 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 18 00:32:50 devstack cinder-volume[86526]: .first() Sep 18 00:32:50 devstack cinder-volume[86526]: Sep 18 00:32:50 devstack sudo[87592]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:50 devstack cinder-volume[86526]: INFO oslo.privsep.daemon [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Spawned new privsep daemon via rootwrap Sep 18 00:32:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Accepted privsep connection to /tmp/tmpzv16gbqm/privsep.sock {{(pid=86526) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 18 00:32:50 devstack cinder-volume[86526]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 18 00:32:50 devstack cinder-volume[86526]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 18 00:32:50 devstack cinder-volume[86526]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 18 00:32:50 devstack cinder-volume[86526]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87608 Sep 18 00:32:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[799d4171-dad1-4584-9b43-305870401ee0]: (2,) {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:32:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-2b69e52a-9924-429d-87d9-6b7f296eccd6 req-07697e5f-1981-414c-89be-b38cb59f89b0 tempest-DeleteServersTestJSON-217444698 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:32:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e767ceb-354b-4e2f-80fc-292910825afd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:32:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:50 devstack sudo[87641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 Sep 18 00:32:50 devstack sudo[87641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:50 devstack sudo[87641]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5" returned: 0 in 0.480s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:50 devstack sudo[87647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb 1G Sep 18 00:32:50 devstack sudo[87647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:51 devstack sudo[87647]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb 1G" returned: 0 in 0.564s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:51 devstack sudo[87689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb Sep 18 00:32:51 devstack sudo[87689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:51 devstack sudo[87689]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb" returned: 0 in 0.319s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:51 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:32:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:51 devstack sudo[87695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb Sep 18 00:32:51 devstack sudo[87695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:51 devstack sudo[87695]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb" returned: 0 in 0.276s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:51 devstack sudo[87698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.info Sep 18 00:32:51 devstack sudo[87698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:52 devstack sudo[87698]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.info" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:52 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:32:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:52 devstack sudo[87701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.info Sep 18 00:32:52 devstack sudo[87701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:52 devstack sudo[87701]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.info" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.993s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:32:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-2b69e52a-9924-429d-87d9-6b7f296eccd6 req-07697e5f-1981-414c-89be-b38cb59f89b0 tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.266s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:32:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-2b69e52a-9924-429d-87d9-6b7f296eccd6 req-07697e5f-1981-414c-89be-b38cb59f89b0 tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:32:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-2b69e52a-9924-429d-87d9-6b7f296eccd6 req-07697e5f-1981-414c-89be-b38cb59f89b0 tempest-DeleteServersTestJSON-217444698 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-42973951-19f0-4ff3-a248-105153ed56c5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '172dce1f-9477-4c4f-9772-ef2da28f5119', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:32:52 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3895f565-ad98-4a2d-93c4-8308473f03f2 tempest-GroupSnapshotsV319Test-113019574 None] group_snapshot b730af8f-347e-4e64-9a60-9a3826330144: created successfully Sep 18 00:32:52 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-2b69e52a-9924-429d-87d9-6b7f296eccd6 req-07697e5f-1981-414c-89be-b38cb59f89b0 tempest-DeleteServersTestJSON-217444698 None] attachment_update completed successfully. Sep 18 00:32:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] group_snapshot b730af8f-347e-4e64-9a60-9a3826330144: deleting Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] group_snapshot b730af8f-347e-4e64-9a60-9a3826330144: deleting {{(pid=86526) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Acquiring lock "cinder-quobyte-830ae9e6-7705-4184-a90b-a3bbc23da2b5" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Lock "cinder-quobyte-830ae9e6-7705-4184-a90b-a3bbc23da2b5" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Acquiring lock "cinder-quobyte-b32391d7-5f9c-4c73-8ecc-799f17857ccb" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Lock "cinder-quobyte-b32391d7-5f9c-4c73-8ecc-799f17857ccb" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Deleting offline snapshot b32391d7-5f9c-4c73-8ecc-799f17857ccb of volume 830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] snapshot_file for this snap is: volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7179228-4fa5-42e0-80fd-3140c099a5b1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:53 devstack sudo[88118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb Sep 18 00:32:53 devstack sudo[88118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:53 devstack sudo[88118]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb" returned: 0 in 0.496s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:32:54 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[593b4536-1ae8-47a0-b499-d34fd5769318]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:32:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:54 devstack sudo[88123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 Sep 18 00:32:54 devstack sudo[88123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:54 devstack sudo[88123]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5" returned: 0 in 0.359s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:54 devstack sudo[88128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb Sep 18 00:32:54 devstack sudo[88128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:54 devstack sudo[88128]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb" returned: 0 in 0.398s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:54 devstack sudo[88139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb Sep 18 00:32:54 devstack sudo[88139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:55 devstack sudo[88139]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5.b32391d7-5f9c-4c73-8ecc-799f17857ccb" returned: 0 in 0.372s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Lock "cinder-quobyte-b32391d7-5f9c-4c73-8ecc-799f17857ccb" released by "_delete_snapshot" :: held 1.771s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:32:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Lock "cinder-quobyte-830ae9e6-7705-4184-a90b-a3bbc23da2b5" released by "delete_snapshot" :: held 1.798s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:32:55 devstack cinder-volume[86526]: WARNING cinder.quota [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-128857942 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-128857942, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:32:55 devstack cinder-volume[86526]: WARNING cinder.quota [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-128857942 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-128857942, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:32:55 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] Created reservations ['4c3202c2-633b-4bec-9b02-fb91e973fec8', 'eba119d4-f1c6-4d66-8606-aaea7ecdda38', 'cc4d2d61-310a-43fe-8c38-b3d468097e29', '8eeb61cc-8a5d-4674-9e1a-dae95772ae26'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:32:55 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5ab38162-155a-4424-b26c-53abc22b7973 tempest-GroupSnapshotsV319Test-113019574 None] group_snapshot b730af8f-347e-4e64-9a60-9a3826330144: deleted successfully Sep 18 00:32:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Acquiring lock "cinder-quobyte-830ae9e6-7705-4184-a90b-a3bbc23da2b5" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:32:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Lock "cinder-quobyte-830ae9e6-7705-4184-a90b-a3bbc23da2b5" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:32:56 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf3e8594-85da-475b-87b0-b26cf3983a3c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:32:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:56 devstack sudo[88188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 Sep 18 00:32:56 devstack sudo[88188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:56 devstack sudo[88188]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5" returned: 0 in 0.535s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:56 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-33ecdd1f-c767-4020-8a3d-e3d93b38a428 req-915f7ff5-8b8a-4f44-a87a-4cd5749c43b3 tempest-DeleteServersTestJSON-217444698 None] Terminate volume connection completed successfully. Sep 18 00:32:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-33ecdd1f-c767-4020-8a3d-e3d93b38a428 req-915f7ff5-8b8a-4f44-a87a-4cd5749c43b3 tempest-DeleteServersTestJSON-217444698 None] Deleting attachment 172dce1f-9477-4c4f-9772-ef2da28f5119. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:32:57 devstack sudo[88196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5 Sep 18 00:32:57 devstack sudo[88196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:57 devstack sudo[88196]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-830ae9e6-7705-4184-a90b-a3bbc23da2b5" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Lock "cinder-quobyte-830ae9e6-7705-4184-a90b-a3bbc23da2b5" released by "delete_volume" :: held 1.060s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Created reservations ['52d7913f-4afb-472a-bc07-e8dcb75f7edb'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:32:57 devstack cinder-volume[86526]: WARNING cinder.quota [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-128857942 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-128857942, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Created reservations ['5b2bc064-0ecb-474f-8074-fadffbea85d1', '8d01f829-7847-46d3-86ec-59a25d16bcbe', 'e24d6c39-1cf3-4929-a429-a0e660697784', '58fb27f0-6786-42e3-8760-221a04cef9cf'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:32:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:57 devstack sudo[88201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:32:57 devstack sudo[88201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:58 devstack sudo[88201]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.280s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:58 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:32:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3ce3a7fc-573c-45c5-9b04-d47c75133490 tempest-GroupSnapshotsV319Test-113019574 None] Delete group completed successfully. Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Acquiring lock "cinder-42973951-19f0-4ff3-a248-105153ed56c5-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Lock "cinder-42973951-19f0-4ff3-a248-105153ed56c5-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Acquiring lock "cinder-quobyte-42973951-19f0-4ff3-a248-105153ed56c5" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Lock "cinder-quobyte-42973951-19f0-4ff3-a248-105153ed56c5" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[45d6babb-72f5-40c6-966c-90be26176802]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:59 devstack sudo[88204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 Sep 18 00:32:59 devstack sudo[88204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:59 devstack sudo[88204]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5" returned: 0 in 0.444s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:32:59 devstack sudo[88209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5 Sep 18 00:32:59 devstack sudo[88209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:32:59 devstack sudo[88209]: pam_unix(sudo:session): session closed for user root Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-42973951-19f0-4ff3-a248-105153ed56c5" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:32:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Lock "cinder-quobyte-42973951-19f0-4ff3-a248-105153ed56c5" released by "delete_volume" :: held 0.786s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:00 devstack cinder-volume[86526]: WARNING cinder.quota [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:33:00 devstack cinder-volume[86526]: WARNING cinder.quota [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Created reservations ['15a41933-0ac9-438f-96e2-365ea9fa89d0', '11a097c3-3ed3-41d2-9396-db42b4db59d0', 'db9c8aca-2ab9-44ec-817b-2c8beac99845', 'aed6d3dc-f3be-4094-8a19-416480e7e5a9'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:00 devstack sudo[88214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:33:00 devstack sudo[88214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:00 devstack sudo[88214]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:33:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Deleted volume successfully. Sep 18 00:33:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7990212a-562b-46a7-aa2d-78511c4e123b tempest-DeleteServersTestJSON-217444698 None] Lock "cinder-42973951-19f0-4ff3-a248-105153ed56c5-delete_volume" released by "delete_volume" :: held 1.528s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:04 devstack sudo[88221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:33:04 devstack sudo[88221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Flow 'volume_create_manager' (30663d1c-4904-43b6-96bc-ce7bb6a2aeed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:04 devstack sudo[88221]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e492d8f-aef8-42ad-87c1-15d1a4f88056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.451s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e492d8f-aef8-42ad-87c1-15d1a4f88056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-177612290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4174f06-dbd7-4f31-a6c2-236e0aca9cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b437528d7940ecae98f8ca0b659a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:05Z,use_quota=True,user_id='3e15d8cf12194a4ea26bba26a7bd65c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd725087-8ed1-4b97-958d-50a546c9fe3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd725087-8ed1-4b97-958d-50a546c9fe3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf387bbd-94bf-4442-a766-ebe7fd1d5f27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cf387bbd-94bf-4442-a766-ebe7fd1d5f27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4174f06-dbd7-4f31-a6c2-236e0aca9cc8', 'volume_name': 'volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717021b4-b736-4d1e-a441-699760414434) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (717021b4-b736-4d1e-a441-699760414434) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6d2956-e8dd-4345-b51d-c54f473958e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:04 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Volume f4174f06-dbd7-4f31-a6c2-236e0aca9cc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8', 'volume_size': 1} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-177612290',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4174f06-dbd7-4f31-a6c2-236e0aca9cc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b437528d7940ecae98f8ca0b659a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:05Z,use_quota=True,user_id='3e15d8cf12194a4ea26bba26a7bd65c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Creating volume f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:33:04 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 8 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:33:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:33:04 devstack sudo[88225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 1073741824 Sep 18 00:33:04 devstack sudo[88225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:05 devstack sudo[88225]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 1073741824" returned: 0 in 0.741s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:05 devstack sudo[88230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 Sep 18 00:33:05 devstack sudo[88230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:06 devstack sudo[88230]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8" returned: 0 in 0.307s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:33:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a6d2956-e8dd-4345-b51d-c54f473958e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8fee7e-61f7-4e44-ab38-257977d22541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:06 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Volume volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 (f4174f06-dbd7-4f31-a6c2-236e0aca9cc8): created successfully Sep 18 00:33:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a8fee7e-61f7-4e44-ab38-257977d22541) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Flow 'volume_create_manager' (30663d1c-4904-43b6-96bc-ce7bb6a2aeed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:06 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f5748c27-8734-4ef5-a744-07a59cee51a0 tempest-ServerActionsTestOtherA-1680223381 None] Created volume successfully. Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Flow 'volume_create_manager' (5c457bec-6ac8-4746-b6dc-740d9132b10e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf1b01a-f986-4bbe-9648-d072d8d73d15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cbf1b01a-f986-4bbe-9648-d072d8d73d15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956879517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d482062c-b375-4247-ad85-9943ae0659c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='019341fb86ea4a4ea6b6d409c2e71021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:12Z,use_quota=True,user_id='1d08d58f822c4a40a6abeaaff261f249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebb66da-b2dd-4c60-a1b1-d4b6c72b7843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebb66da-b2dd-4c60-a1b1-d4b6c72b7843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fe0a67-f74d-40b2-b1fe-28a5919d5c5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74fe0a67-f74d-40b2-b1fe-28a5919d5c5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd482062c-b375-4247-ad85-9943ae0659c5', 'volume_name': 'volume-d482062c-b375-4247-ad85-9943ae0659c5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e0d4a4-1bb5-4f8f-9794-9a43486620fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51e0d4a4-1bb5-4f8f-9794-9a43486620fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40392c65-4749-4147-9433-2e221e7f0f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:11 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Volume d482062c-b375-4247-ad85-9943ae0659c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d482062c-b375-4247-ad85-9943ae0659c5', 'volume_size': 1} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-956879517',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d482062c-b375-4247-ad85-9943ae0659c5,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='019341fb86ea4a4ea6b6d409c2e71021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:12Z,use_quota=True,user_id='1d08d58f822c4a40a6abeaaff261f249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Creating volume d482062c-b375-4247-ad85-9943ae0659c5 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:33:11 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:33:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:11 devstack sudo[88261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 1073741824 Sep 18 00:33:11 devstack sudo[88261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:12 devstack sudo[88261]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 1073741824" returned: 0 in 0.540s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:12 devstack sudo[88273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 Sep 18 00:33:12 devstack sudo[88273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:12 devstack sudo[88273]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5" returned: 0 in 0.288s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.901s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (40392c65-4749-4147-9433-2e221e7f0f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d482062c-b375-4247-ad85-9943ae0659c5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f1e6dc-8231-4c39-a00b-de85f2cbd10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:12 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Volume volume-d482062c-b375-4247-ad85-9943ae0659c5 (d482062c-b375-4247-ad85-9943ae0659c5): created successfully Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43f1e6dc-8231-4c39-a00b-de85f2cbd10b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Flow 'volume_create_manager' (5c457bec-6ac8-4746-b6dc-740d9132b10e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4a2c2214-9c1b-44d1-a034-bec419950b24 tempest-VolumesTestJSON-542125391 None] Created volume successfully. Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Flow 'volume_create_manager' (4f201368-1962-4e02-8ab2-0bba26fe74f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39e4637-1c5a-4325-ab02-9e72d6b7255a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39e4637-1c5a-4325-ab02-9e72d6b7255a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-889897887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038a0fb0-c981-476b-a6c8-2a46c3de75e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='019341fb86ea4a4ea6b6d409c2e71021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:15Z,use_quota=True,user_id='1d08d58f822c4a40a6abeaaff261f249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f40fb-d12a-41b1-a3aa-90a80fe55342) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (437f40fb-d12a-41b1-a3aa-90a80fe55342) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18044325-4ec7-49ae-a37c-86c00554f3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (18044325-4ec7-49ae-a37c-86c00554f3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '038a0fb0-c981-476b-a6c8-2a46c3de75e0', 'volume_name': 'volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb10c3fa-93e5-4ad3-bcff-72a54c173933) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb10c3fa-93e5-4ad3-bcff-72a54c173933) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a82d39-1107-40c3-9e78-67fa5f54412b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Volume 038a0fb0-c981-476b-a6c8-2a46c3de75e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0', 'volume_size': 1} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-889897887',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=038a0fb0-c981-476b-a6c8-2a46c3de75e0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='019341fb86ea4a4ea6b6d409c2e71021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:15Z,use_quota=True,user_id='1d08d58f822c4a40a6abeaaff261f249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Creating volume 038a0fb0-c981-476b-a6c8-2a46c3de75e0 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:33:14 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:33:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:14 devstack sudo[88300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 1073741824 Sep 18 00:33:14 devstack sudo[88300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:15 devstack sudo[88300]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 1073741824" returned: 0 in 0.767s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:15 devstack sudo[88324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 Sep 18 00:33:15 devstack sudo[88324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:16 devstack sudo[88324]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0" returned: 0 in 0.396s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] <== create_volume: return (1248ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:33:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.251s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (30a82d39-1107-40c3-9e78-67fa5f54412b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760e4e78-a189-4355-b027-68a0425aa707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Volume volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 (038a0fb0-c981-476b-a6c8-2a46c3de75e0): created successfully Sep 18 00:33:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (760e4e78-a189-4355-b027-68a0425aa707) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Flow 'volume_create_manager' (4f201368-1962-4e02-8ab2-0bba26fe74f9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e1ad641c-91c5-460e-aa57-e2a620e42c3a tempest-VolumesTestJSON-542125391 None] Created volume successfully. Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Flow 'volume_create_manager' (dba125f4-0a49-4cda-9f1b-282290d1436a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c27b3bd-bca8-418d-9ad4-61af12b4615a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7c27b3bd-bca8-418d-9ad4-61af12b4615a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1119339178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='019341fb86ea4a4ea6b6d409c2e71021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:18Z,use_quota=True,user_id='1d08d58f822c4a40a6abeaaff261f249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46509774-cb49-416f-9cc3-7d7989cea33d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46509774-cb49-416f-9cc3-7d7989cea33d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0880ec66-c0e0-4c72-9874-bf9ae8673190) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0880ec66-c0e0-4c72-9874-bf9ae8673190) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab', 'volume_name': 'volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cb0040-df82-4dd7-ac5a-79b9bc6086d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59cb0040-df82-4dd7-ac5a-79b9bc6086d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e89579a-934c-48a5-8d90-d127ad64d2de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Volume dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab', 'volume_size': 1} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1119339178',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='019341fb86ea4a4ea6b6d409c2e71021',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:18Z,use_quota=True,user_id='1d08d58f822c4a40a6abeaaff261f249',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Creating volume dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:33:17 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:33:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:17 devstack sudo[88331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab 1073741824 Sep 18 00:33:17 devstack sudo[88331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:18 devstack sudo[88331]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab 1073741824" returned: 0 in 0.959s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:18 devstack sudo[88337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab Sep 18 00:33:18 devstack sudo[88337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:19 devstack sudo[88337]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab" returned: 0 in 0.470s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] <== create_volume: return (1525ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:33:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e89579a-934c-48a5-8d90-d127ad64d2de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab173513-e0f1-4156-9bfc-9b4edae37e5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Volume volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab (dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab): created successfully Sep 18 00:33:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab173513-e0f1-4156-9bfc-9b4edae37e5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Flow 'volume_create_manager' (dba125f4-0a49-4cda-9f1b-282290d1436a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-882e43a8-0d5f-4cfe-9418-c601c9d6d1e8 tempest-VolumesTestJSON-542125391 None] Created volume successfully. Sep 18 00:33:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-efec63ac-372c-4b01-8ba9-9b8f24ee0a53 tempest-GroupsV314Test-19862485 None] Group tempest-GroupsV314Test-Group-627557262: creating Sep 18 00:33:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-efec63ac-372c-4b01-8ba9-9b8f24ee0a53 tempest-GroupsV314Test-19862485 None] Group tempest-GroupsV314Test-Group-627557262: created successfully Sep 18 00:33:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-efec63ac-372c-4b01-8ba9-9b8f24ee0a53 tempest-GroupsV314Test-19862485 None] Create group completed successfully. Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Acquiring lock "cinder-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Lock "cinder-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Acquiring lock "cinder-quobyte-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Lock "cinder-quobyte-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab" acquired by "delete_volume" :: waited 0.064s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[60ea35e2-769b-48a5-b4ea-8b48fed294bd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:21 devstack sudo[88344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab Sep 18 00:33:21 devstack sudo[88344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:33:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Flow 'volume_create_manager' (e262e21c-067d-4bda-b1b7-6fde4fa7a163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fc1523-d7fd-4765-8f8c-5d1462f1d923) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75fc1523-d7fd-4765-8f8c-5d1462f1d923) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966651199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=420dc5a9-56dd-4bf7-aff6-6e31b076deac,host='devstack@QuobyteHD#QuobyteHD',id=3cdc78c9-b783-4075-8244-fe708650fe71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2799f30bf1b41d4ba9719da4fa6dc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:22Z,use_quota=True,user_id='539a00d23f99496e881fcca348188ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6678e30-db47-43a5-8b7b-581f76679fac),volume_type_id=d6678e30-db47-43a5-8b7b-581f76679fac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46099960-0c7e-4e06-bfef-c5e7d00e00a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46099960-0c7e-4e06-bfef-c5e7d00e00a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70714dee-b50d-4e76-a675-3d5b45ae624f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70714dee-b50d-4e76-a675-3d5b45ae624f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3cdc78c9-b783-4075-8244-fe708650fe71', 'volume_name': 'volume-3cdc78c9-b783-4075-8244-fe708650fe71', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b16d6d-f3b7-4703-a350-3153de1eefcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7b16d6d-f3b7-4703-a350-3153de1eefcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bed6bef-2ed7-4a63-bdf0-ecfd003d41de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Volume 3cdc78c9-b783-4075-8244-fe708650fe71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3cdc78c9-b783-4075-8244-fe708650fe71', 'volume_size': 1} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=420dc5a9-56dd-4bf7-aff6-6e31b076deac,created_at=2026-09-17T22:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-966651199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=420dc5a9-56dd-4bf7-aff6-6e31b076deac,host='devstack@QuobyteHD#QuobyteHD',id=3cdc78c9-b783-4075-8244-fe708650fe71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2799f30bf1b41d4ba9719da4fa6dc07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:33:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:33:22Z,use_quota=True,user_id='539a00d23f99496e881fcca348188ed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d6678e30-db47-43a5-8b7b-581f76679fac),volume_type_id=d6678e30-db47-43a5-8b7b-581f76679fac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Creating volume 3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:33:22 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:22 devstack sudo[88348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 1073741824 Sep 18 00:33:22 devstack sudo[88348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:22 devstack sudo[88344]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab" returned: 0 in 0.479s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:22 devstack sudo[88351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab Sep 18 00:33:22 devstack sudo[88351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:22 devstack sudo[88351]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab" returned: 0 in 0.355s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Lock "cinder-quobyte-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab" released by "delete_volume" :: held 0.931s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Created reservations ['fd81aa77-c35f-4c00-a5ce-a9d6c3df02f1', 'cefdb069-a41e-4210-8579-6039871ed3e2', '8a79bf2b-e281-4514-b5f0-7d347714ccbc', 'edd5d756-615c-4aed-a644-2c4222099698'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:22 devstack sudo[88348]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 1073741824" returned: 0 in 0.645s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:22 devstack sudo[88358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:33:22 devstack sudo[88358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:22 devstack sudo[88360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 Sep 18 00:33:22 devstack sudo[88360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:23 devstack sudo[88358]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.374s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:33:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Deleted volume successfully. Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64cdf01b-5a09-4182-9e64-c831d64fd99e tempest-VolumesTestJSON-542125391 None] Lock "cinder-dec11ec6-6cd4-46a5-a07c-c9f1d587d4ab-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:23 devstack sudo[88360]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71" returned: 0 in 0.438s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] <== create_volume: return (1173ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.179s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bed6bef-2ed7-4a63-bdf0-ecfd003d41de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3cdc78c9-b783-4075-8244-fe708650fe71', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5d9f0c-6aef-4616-8d7b-5d2364c7889e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:33:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Volume volume-3cdc78c9-b783-4075-8244-fe708650fe71 (3cdc78c9-b783-4075-8244-fe708650fe71): created successfully Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad5d9f0c-6aef-4616-8d7b-5d2364c7889e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Flow 'volume_create_manager' (e262e21c-067d-4bda-b1b7-6fde4fa7a163) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:33:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d84e535b-5cef-4d05-8ca8-ccf3d74205e4 tempest-GroupsV314Test-19862485 None] Created volume successfully. Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Acquiring lock "cinder-038a0fb0-c981-476b-a6c8-2a46c3de75e0-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Lock "cinder-038a0fb0-c981-476b-a6c8-2a46c3de75e0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Acquiring lock "cinder-quobyte-038a0fb0-c981-476b-a6c8-2a46c3de75e0" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Lock "cinder-quobyte-038a0fb0-c981-476b-a6c8-2a46c3de75e0" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[237e57ee-5e23-4335-8627-03f6a17b88eb]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:24 devstack sudo[88364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 Sep 18 00:33:24 devstack sudo[88364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:24 devstack sudo[88364]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0" returned: 0 in 0.419s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:24 devstack sudo[88369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0 Sep 18 00:33:24 devstack sudo[88369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:24 devstack sudo[88369]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-038a0fb0-c981-476b-a6c8-2a46c3de75e0" returned: 0 in 0.282s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Lock "cinder-quobyte-038a0fb0-c981-476b-a6c8-2a46c3de75e0" released by "delete_volume" :: held 0.753s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Created reservations ['dfdb1989-b6fb-487b-a2cb-e35baada9f48', 'a45ddbe6-0911-432f-987a-dbe4ed634e09', 'a8f5ab24-0dd6-4c7e-b8ed-40c3443d57e2', '189a76f5-3cfc-4ca6-9378-fe988148efbd'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:24 devstack sudo[88372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:33:24 devstack sudo[88372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Acquiring lock "cinder-d482062c-b375-4247-ad85-9943ae0659c5-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Lock "cinder-d482062c-b375-4247-ad85-9943ae0659c5-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:25 devstack sudo[88372]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.383s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:33:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Deleted volume successfully. Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Acquiring lock "cinder-quobyte-d482062c-b375-4247-ad85-9943ae0659c5" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cc4fbb47-d2c5-4094-bdb0-628026ad1890 tempest-VolumesTestJSON-542125391 None] Lock "cinder-038a0fb0-c981-476b-a6c8-2a46c3de75e0-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Lock "cinder-quobyte-d482062c-b375-4247-ad85-9943ae0659c5" acquired by "delete_volume" :: waited 0.081s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[36321e88-0934-4886-9545-abc60747556e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:25 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Cloning volume 3cdc78c9-b783-4075-8244-fe708650fe71 to volume d2caf046-947e-4d1d-ba20-51b4a1fee965 Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Creating offline snapshot 662140fb-7c6f-4d61-a1ff-296d0d51b330 of volume 3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[96376b55-1783-478b-9f92-7e3dc5ef005b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:25 devstack sudo[88375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 Sep 18 00:33:25 devstack sudo[88375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:25 devstack sudo[88376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 Sep 18 00:33:25 devstack sudo[88376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:26 devstack sudo[88375]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5" returned: 0 in 0.707s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:26 devstack sudo[88385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5 Sep 18 00:33:26 devstack sudo[88385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:26 devstack sudo[88376]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71" returned: 0 in 0.606s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:26 devstack sudo[88387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 1G Sep 18 00:33:26 devstack sudo[88387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:26 devstack sudo[88385]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d482062c-b375-4247-ad85-9943ae0659c5" returned: 0 in 0.316s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Lock "cinder-quobyte-d482062c-b375-4247-ad85-9943ae0659c5" released by "delete_volume" :: held 1.111s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Created reservations ['7e061048-e830-4e28-a031-870a3f71318e', '42c4d8be-3942-4a6e-8bb4-6faa9ae9a3a6', '812770f6-8148-47dd-bb5d-1bb68470e3ea', '03344c65-41a3-49b7-b0dc-b6baec01b077'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:26 devstack sudo[88393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:33:26 devstack sudo[88393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:27 devstack sudo[88387]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 1G" returned: 0 in 0.788s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cdc78c9-b783-4075-8244-fe708650fe71 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:27 devstack sudo[88396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cdc78c9-b783-4075-8244-fe708650fe71 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 Sep 18 00:33:27 devstack sudo[88396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:27 devstack sudo[88393]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.491s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:27 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:33:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Deleted volume successfully. Sep 18 00:33:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f8e434c5-0779-4c36-bf2b-9b35cfaea90c tempest-VolumesTestJSON-542125391 None] Lock "cinder-d482062c-b375-4247-ad85-9943ae0659c5-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:27 devstack sudo[88396]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3cdc78c9-b783-4075-8244-fe708650fe71 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330" returned: 0 in 0.630s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:27 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:33:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:27 devstack sudo[88402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 Sep 18 00:33:27 devstack sudo[88402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:28 devstack sudo[88402]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330" returned: 0 in 0.334s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:28 devstack sudo[88405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.info Sep 18 00:33:28 devstack sudo[88405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:28 devstack sudo[88405]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.info" returned: 0 in 0.358s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:28 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:28 devstack sudo[88408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.info Sep 18 00:33:28 devstack sudo[88408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:28 devstack sudo[88408]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.info" returned: 0 in 0.308s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Acquiring lock "cinder-quobyte-d2caf046-947e-4d1d-ba20-51b4a1fee965" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-d2caf046-947e-4d1d-ba20-51b4a1fee965" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] snapshot: 662140fb-7c6f-4d61-a1ff-296d0d51b330, volume: d2caf046-947e-4d1d-ba20-51b4a1fee965, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[966a4f12-2b5c-4331-98bc-9a2c8c9cd124]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:29 devstack sudo[88412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 Sep 18 00:33:29 devstack sudo[88412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:29 devstack sudo[88412]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330" returned: 0 in 0.570s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cdc78c9-b783-4075-8244-fe708650fe71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca4c57f1-4fa0-45b7-a19e-6cc3d022576c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:29 devstack sudo[88440]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 Sep 18 00:33:29 devstack sudo[88440]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:29 devstack sudo[88440]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71" returned: 0 in 0.475s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:33:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:29 devstack sudo[88447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 Sep 18 00:33:29 devstack sudo[88447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:38 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=81,cinder:SELECT=72,cinder:DELETE=5,cinder:INSERT=13 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:33:38 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=70,cinder:UPDATE=71,cinder:INSERT=22,cinder:DELETE=6 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:33:39 devstack sudo[88447]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965" returned: 0 in 9.241s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71, size 1024.00 MB, duration 9.24 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:33:39 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Converted 1024.00 MB image at 110.80 MB/s Sep 18 00:33:39 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:39 devstack sudo[88476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 Sep 18 00:33:39 devstack sudo[88476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:39 devstack sudo[88476]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965" returned: 0 in 0.302s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-d2caf046-947e-4d1d-ba20-51b4a1fee965" released by "_copy_volume_from_snapshot" :: held 10.703s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Acquiring lock "cinder-quobyte-662140fb-7c6f-4d61-a1ff-296d0d51b330" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-662140fb-7c6f-4d61-a1ff-296d0d51b330" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Deleting offline snapshot 662140fb-7c6f-4d61-a1ff-296d0d51b330 of volume 3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] snapshot_file for this snap is: volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7dfbc85c-8041-41ee-9499-2c7ae4410e36]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:39 devstack sudo[88479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 Sep 18 00:33:39 devstack sudo[88479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:40 devstack sudo[88479]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3cdc78c9-b783-4075-8244-fe708650fe71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:33:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9056aaca-67db-4d27-9d0f-3e07d3978e6a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:40 devstack sudo[88487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 Sep 18 00:33:40 devstack sudo[88487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:40 devstack sudo[88487]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71" returned: 0 in 0.682s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:40 devstack sudo[88493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 Sep 18 00:33:40 devstack sudo[88493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:41 devstack sudo[88493]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330" returned: 0 in 0.459s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:41 devstack sudo[88498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330 Sep 18 00:33:41 devstack sudo[88498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:41 devstack sudo[88498]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71.662140fb-7c6f-4d61-a1ff-296d0d51b330" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-662140fb-7c6f-4d61-a1ff-296d0d51b330" released by "_delete_snapshot" :: held 2.058s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 16.096s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f800644e-c6f0-40bb-af7d-cfcd8bac1356 tempest-GroupsV314Test-19862485 None] Create group from source-group-420dc5a9-56dd-4bf7-aff6-6e31b076deac completed successfully. Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e30ed8d4-1ec5-4e3f-ba7b-fef010a52e33 req-083c9674-3cda-4fdb-9b49-ae02437484f0 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e30ed8d4-1ec5-4e3f-ba7b-fef010a52e33 req-083c9674-3cda-4fdb-9b49-ae02437484f0 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e30ed8d4-1ec5-4e3f-ba7b-fef010a52e33 req-083c9674-3cda-4fdb-9b49-ae02437484f0 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e30ed8d4-1ec5-4e3f-ba7b-fef010a52e33 req-083c9674-3cda-4fdb-9b49-ae02437484f0 tempest-ServerActionsTestOtherA-1680223381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1c60cb45-5a5f-4698-aaef-792d7bf61f66', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Acquiring lock "cinder-quobyte-d2caf046-947e-4d1d-ba20-51b4a1fee965" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-d2caf046-947e-4d1d-ba20-51b4a1fee965" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-e30ed8d4-1ec5-4e3f-ba7b-fef010a52e33 req-083c9674-3cda-4fdb-9b49-ae02437484f0 tempest-ServerActionsTestOtherA-1680223381 None] attachment_update completed successfully. Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2734294b-322a-4658-b297-d72a96b544e0]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:42 devstack sudo[88515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 Sep 18 00:33:42 devstack sudo[88515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:43 devstack sudo[88515]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965" returned: 0 in 0.622s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:43 devstack sudo[88940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965 Sep 18 00:33:43 devstack sudo[88940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:43 devstack sudo[88940]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d2caf046-947e-4d1d-ba20-51b4a1fee965" returned: 0 in 0.477s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-d2caf046-947e-4d1d-ba20-51b4a1fee965" released by "delete_volume" :: held 1.186s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:43 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Created reservations ['96d90dd4-6428-4fd7-a789-d63236312b89'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:44 devstack cinder-volume[86526]: WARNING cinder.quota [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1402143902 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1402143902, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:33:44 devstack cinder-volume[86526]: WARNING cinder.quota [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1402143902 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1402143902, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Created reservations ['080b9426-8942-44b2-8649-645c7f719264', 'bf8e2a39-1125-4e00-a273-db978b2ba825', '40cf7a9f-fd6a-45ad-945c-27d83af4223e', 'dc940dea-6165-4660-9752-999315b1d9e3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:44 devstack sudo[88950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:33:44 devstack sudo[88950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:44 devstack sudo[88950]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.453s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:44 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:33:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ec587229-a43e-488a-9dbd-8aa3d4c98d00 tempest-GroupsV314Test-19862485 None] Delete group completed successfully. Sep 18 00:33:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Acquiring lock "cinder-quobyte-3cdc78c9-b783-4075-8244-fe708650fe71" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:33:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-3cdc78c9-b783-4075-8244-fe708650fe71" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:33:45 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d15138a5-ea95-4051-a65e-fdf7aa0ec329]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:33:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:45 devstack sudo[88956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 Sep 18 00:33:45 devstack sudo[88956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:46 devstack sudo[88956]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71" returned: 0 in 0.574s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:46 devstack sudo[88965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71 Sep 18 00:33:46 devstack sudo[88965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:46 devstack sudo[88965]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3cdc78c9-b783-4075-8244-fe708650fe71" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Lock "cinder-quobyte-3cdc78c9-b783-4075-8244-fe708650fe71" released by "delete_volume" :: held 1.107s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:33:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-5c8bf165-7b1b-4cd2-8790-ca6e47924571 req-bb8f3e43-2477-45d1-9491-a6ddefd84b3f tempest-ServerActionsTestOtherA-1680223381 None] Terminate volume connection completed successfully. Sep 18 00:33:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-5c8bf165-7b1b-4cd2-8790-ca6e47924571 req-bb8f3e43-2477-45d1-9491-a6ddefd84b3f tempest-ServerActionsTestOtherA-1680223381 None] Deleting attachment 1c60cb45-5a5f-4698-aaef-792d7bf61f66. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:33:46 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Created reservations ['16f2eca9-6571-498b-a3fa-8d6e68dd81a0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Created reservations ['d7109f3f-dd75-4556-bf8d-bdd4c2d9cc07', 'b6f4c6e4-4427-4938-9772-c23ef8d8f5c0', 'dafdbed4-9263-4f3f-9e52-2c96ad4f036e', '02f27978-e9e0-40cc-9362-32b8b7b84af6'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:33:47 devstack sudo[89004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:33:47 devstack sudo[89004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:33:47 devstack sudo[89004]: pam_unix(sudo:session): session closed for user root Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.479s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:33:47 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:33:47 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-52a45155-69da-4f4a-9e2e-b2f09eefb50a tempest-GroupsV314Test-19862485 None] Delete group completed successfully. Sep 18 00:33:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-5c8bf165-7b1b-4cd2-8790-ca6e47924571 req-b3b7a833-7851-4974-8927-77994e069d2a tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:33:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-5c8bf165-7b1b-4cd2-8790-ca6e47924571 req-b3b7a833-7851-4974-8927-77994e069d2a tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:33:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-5c8bf165-7b1b-4cd2-8790-ca6e47924571 req-b3b7a833-7851-4974-8927-77994e069d2a tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:33:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-5c8bf165-7b1b-4cd2-8790-ca6e47924571 req-b3b7a833-7851-4974-8927-77994e069d2a tempest-ServerActionsTestOtherA-1680223381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '09e79d8a-46c5-4a20-a2d7-5ab201647079', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:33:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-5c8bf165-7b1b-4cd2-8790-ca6e47924571 req-b3b7a833-7851-4974-8927-77994e069d2a tempest-ServerActionsTestOtherA-1680223381 None] attachment_update completed successfully. Sep 18 00:33:58 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=21,cinder:SELECT=33,cinder:INSERT=6 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:33:58 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=35,cinder:SELECT=32,cinder:INSERT=4 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:34:00 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Flow 'volume_create_manager' (5f9e0d95-1f75-4d8b-bb5f-eac8b80a74e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8cb513-be59-4863-9a71-b5c6507ecb7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a8cb513-be59-4863-9a71-b5c6507ecb7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1421231272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea7bf39-0885-415f-9016-279131fd24e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad445cca298e46089823c48d9e9038b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:01Z,use_quota=True,user_id='29bf75a976434f7297c9a309c3beef54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a45598-40f0-41e3-b3ab-03d442a284fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b4a45598-40f0-41e3-b3ab-03d442a284fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a08689a-e81b-4a7f-8a5e-9be5114e0f45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a08689a-e81b-4a7f-8a5e-9be5114e0f45) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ea7bf39-0885-415f-9016-279131fd24e1', 'volume_name': 'volume-1ea7bf39-0885-415f-9016-279131fd24e1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f002d4c-b1d4-4e8f-9029-7de49122c66c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f002d4c-b1d4-4e8f-9029-7de49122c66c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81d95d8-01d5-451d-90a8-e0fcc6a7aab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:01 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Volume 1ea7bf39-0885-415f-9016-279131fd24e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ea7bf39-0885-415f-9016-279131fd24e1', 'volume_size': 1} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1421231272',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ea7bf39-0885-415f-9016-279131fd24e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad445cca298e46089823c48d9e9038b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:01Z,use_quota=True,user_id='29bf75a976434f7297c9a309c3beef54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Creating volume 1ea7bf39-0885-415f-9016-279131fd24e1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:01 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:01 devstack sudo[89539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 1073741824 Sep 18 00:34:01 devstack sudo[89539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:01 devstack sudo[89539]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 1073741824" returned: 0 in 0.653s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:01 devstack sudo[89545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 Sep 18 00:34:01 devstack sudo[89545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:02 devstack sudo[89545]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1" returned: 0 in 0.416s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d81d95d8-01d5-451d-90a8-e0fcc6a7aab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ea7bf39-0885-415f-9016-279131fd24e1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0760ec8f-082c-4647-86b1-4b368ee7b2ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:02 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Volume volume-1ea7bf39-0885-415f-9016-279131fd24e1 (1ea7bf39-0885-415f-9016-279131fd24e1): created successfully Sep 18 00:34:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0760ec8f-082c-4647-86b1-4b368ee7b2ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Flow 'volume_create_manager' (5f9e0d95-1f75-4d8b-bb5f-eac8b80a74e2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:02 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-49163c60-98e5-4a59-a89a-2e66532995bf tempest-VolumeQuotasAdminTestJSON-399758260 None] Created volume successfully. Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Acquiring lock "cinder-1ea7bf39-0885-415f-9016-279131fd24e1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "cinder-1ea7bf39-0885-415f-9016-279131fd24e1-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Acquiring lock "cinder-quobyte-1ea7bf39-0885-415f-9016-279131fd24e1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "cinder-quobyte-1ea7bf39-0885-415f-9016-279131fd24e1" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[45608871-61a6-462c-bce2-8a4757d39d35]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:03 devstack sudo[89548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 Sep 18 00:34:03 devstack sudo[89548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:03 devstack sudo[89548]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1" returned: 0 in 0.443s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:03 devstack sudo[89553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1 Sep 18 00:34:03 devstack sudo[89553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:04 devstack sudo[89553]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-1ea7bf39-0885-415f-9016-279131fd24e1" returned: 0 in 0.439s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "cinder-quobyte-1ea7bf39-0885-415f-9016-279131fd24e1" released by "delete_volume" :: held 0.962s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:04 devstack sudo[89583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:04 devstack sudo[89583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Created reservations ['e80677bb-4be3-4bea-9302-0c72667f81a3', '76ebdf82-2834-4ad2-a968-7bd5e8500628', 'f93a3784-e568-40a8-b3af-e52f6a9a12b7', '18e9ad13-60dd-49fb-b8dc-11775d676a6d'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:04 devstack sudo[89585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:04 devstack sudo[89585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:04 devstack sudo[89583]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.432s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 8 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:34:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:34:05 devstack sudo[89585]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:05 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:05 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Deleted volume successfully. Sep 18 00:34:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a1f56c9e-f330-4c41-af19-7ca5471c0906 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "cinder-1ea7bf39-0885-415f-9016-279131fd24e1-delete_volume" released by "delete_volume" :: held 1.864s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Flow 'volume_create_manager' (2ad56d98-d9c9-4194-9bfc-7294ed35f5ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7237a23a-6a63-4f4e-aa5e-2927582ee514) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7237a23a-6a63-4f4e-aa5e-2927582ee514) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-748991560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408a17e8-9539-49ca-818f-bae78692c394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad445cca298e46089823c48d9e9038b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:06Z,use_quota=True,user_id='29bf75a976434f7297c9a309c3beef54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b764b45-cb73-4e98-b8cb-daa0a5c3dece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b764b45-cb73-4e98-b8cb-daa0a5c3dece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea2cc08-fef7-44b1-b956-e562c3af739f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ea2cc08-fef7-44b1-b956-e562c3af739f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '408a17e8-9539-49ca-818f-bae78692c394', 'volume_name': 'volume-408a17e8-9539-49ca-818f-bae78692c394', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7a2d35-bc12-444e-a3aa-93721cee5788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f7a2d35-bc12-444e-a3aa-93721cee5788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72c7c94-386a-4c68-96ae-730b1b4c264d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:06 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Volume 408a17e8-9539-49ca-818f-bae78692c394: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-408a17e8-9539-49ca-818f-bae78692c394', 'volume_size': 1} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-748991560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=408a17e8-9539-49ca-818f-bae78692c394,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ad445cca298e46089823c48d9e9038b7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:06Z,use_quota=True,user_id='29bf75a976434f7297c9a309c3beef54',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Creating volume 408a17e8-9539-49ca-818f-bae78692c394 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:06 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:06 devstack sudo[89594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 1073741824 Sep 18 00:34:06 devstack sudo[89594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:06 devstack sudo[89594]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 1073741824" returned: 0 in 0.545s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:06 devstack sudo[89601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 Sep 18 00:34:06 devstack sudo[89601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:07 devstack sudo[89601]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a72c7c94-386a-4c68-96ae-730b1b4c264d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-408a17e8-9539-49ca-818f-bae78692c394', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50d4ac4-e5dd-45d3-9619-a87652b3df9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Volume volume-408a17e8-9539-49ca-818f-bae78692c394 (408a17e8-9539-49ca-818f-bae78692c394): created successfully Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f50d4ac4-e5dd-45d3-9619-a87652b3df9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Flow 'volume_create_manager' (2ad56d98-d9c9-4194-9bfc-7294ed35f5ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:07 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-03d79d13-ba18-451b-8eaa-3bb25d23b550 tempest-VolumeQuotasAdminTestJSON-399758260 None] Created volume successfully. Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Flow 'volume_create_manager' (f0b04830-ff64-4e22-93de-694b4eca9884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6ed895-bec6-415b-b2ad-5989c7c97a03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ee6ed895-bec6-415b-b2ad-5989c7c97a03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-883663891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add672d0-8c33-483c-85c6-a38139ab4b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab467e8fe09b47959e1d945e713ca982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:07Z,use_quota=True,user_id='bb4163bbde12459b9fc65ebd592f4e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36625f90-9734-47cf-b4cd-c69775d35f25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (36625f90-9734-47cf-b4cd-c69775d35f25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79bef23-7758-4518-a558-bf3ef5a8ef88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b79bef23-7758-4518-a558-bf3ef5a8ef88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'add672d0-8c33-483c-85c6-a38139ab4b50', 'volume_name': 'volume-add672d0-8c33-483c-85c6-a38139ab4b50', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac568622-32c3-4133-92fb-5b71a2cc55e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac568622-32c3-4133-92fb-5b71a2cc55e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3818d4d-d1cd-47f2-b0a3-aa0b76e83438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Volume add672d0-8c33-483c-85c6-a38139ab4b50: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-add672d0-8c33-483c-85c6-a38139ab4b50', 'volume_size': 1} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-883663891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=add672d0-8c33-483c-85c6-a38139ab4b50,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ab467e8fe09b47959e1d945e713ca982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:07Z,use_quota=True,user_id='bb4163bbde12459b9fc65ebd592f4e44',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Creating volume add672d0-8c33-483c-85c6-a38139ab4b50 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:07 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:07 devstack sudo[89606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 1073741824 Sep 18 00:34:07 devstack sudo[89606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:07 devstack sudo[89606]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 1073741824" returned: 0 in 0.524s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:08 devstack sudo[89623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 Sep 18 00:34:08 devstack sudo[89623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:08 devstack sudo[89623]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50" returned: 0 in 0.326s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f3818d4d-d1cd-47f2-b0a3-aa0b76e83438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-add672d0-8c33-483c-85c6-a38139ab4b50', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b448473-4706-4176-99f1-627413ff08b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:08 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Volume volume-add672d0-8c33-483c-85c6-a38139ab4b50 (add672d0-8c33-483c-85c6-a38139ab4b50): created successfully Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8b448473-4706-4176-99f1-627413ff08b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Flow 'volume_create_manager' (f0b04830-ff64-4e22-93de-694b4eca9884) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:08 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f74de86f-0965-4854-9787-20529137ea46 tempest-VolumeQuotasNegativeTestJSON-992460240 None] Created volume successfully. Sep 18 00:34:09 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7e799aac-5581-4113-925f-c8fcd9c27971 tempest-VolumeQuotasAdminTestJSON-626219335 None] Transfer volume completed successfully. Sep 18 00:34:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Acquiring lock "cinder-408a17e8-9539-49ca-818f-bae78692c394-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Lock "cinder-408a17e8-9539-49ca-818f-bae78692c394-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Acquiring lock "cinder-quobyte-408a17e8-9539-49ca-818f-bae78692c394" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Lock "cinder-quobyte-408a17e8-9539-49ca-818f-bae78692c394" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:09 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3fba4801-b943-478d-bf2d-ba366f127c24]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:09 devstack sudo[89634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 Sep 18 00:34:09 devstack sudo[89634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:10 devstack sudo[89634]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394" returned: 0 in 0.429s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:10 devstack sudo[89664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394 Sep 18 00:34:10 devstack sudo[89664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:10 devstack sudo[89664]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-408a17e8-9539-49ca-818f-bae78692c394" returned: 0 in 0.456s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Lock "cinder-quobyte-408a17e8-9539-49ca-818f-bae78692c394" released by "delete_volume" :: held 0.961s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Created reservations ['8639a512-75be-4cfb-8e55-183e17c47281', 'cf30d59e-c7ae-4fcb-be46-1b6672804abb', '0a4f3f65-09d9-4f44-9334-61f6170a55fb', 'c5a3c26b-6f28-40dd-bc60-e87dedb7d8ea'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:10 devstack sudo[89721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:10 devstack sudo[89721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Acquiring lock "cinder-add672d0-8c33-483c-85c6-a38139ab4b50-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "cinder-add672d0-8c33-483c-85c6-a38139ab4b50-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Acquiring lock "cinder-quobyte-add672d0-8c33-483c-85c6-a38139ab4b50" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "cinder-quobyte-add672d0-8c33-483c-85c6-a38139ab4b50" acquired by "delete_volume" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6f30079-e7a5-4313-82be-6b1340a1180f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:11 devstack sudo[89721]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.497s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:11 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Deleted volume successfully. Sep 18 00:34:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c2f8891-67cf-4c9d-a5fc-d735e076ccb9 tempest-VolumeQuotasAdminTestJSON-396002441 None] Lock "cinder-408a17e8-9539-49ca-818f-bae78692c394-delete_volume" released by "delete_volume" :: held 1.929s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:11 devstack sudo[89732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 Sep 18 00:34:11 devstack sudo[89732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:12 devstack sudo[89732]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50" returned: 0 in 0.678s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:12 devstack sudo[89744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50 Sep 18 00:34:12 devstack sudo[89744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:12 devstack sudo[89744]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-add672d0-8c33-483c-85c6-a38139ab4b50" returned: 0 in 0.503s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "cinder-quobyte-add672d0-8c33-483c-85c6-a38139ab4b50" released by "delete_volume" :: held 1.303s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Created reservations ['0649b537-6f65-4e6d-bd8d-3ccf4a30c9c7', '011e1ee3-4365-4fc6-800a-67acc2e1155b', 'd26da35d-0bc5-48e6-b7a2-c5dfab6baa9d', 'e38948c8-557f-4690-bac7-482bae6cfc58'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:12 devstack sudo[89755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:12 devstack sudo[89755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:13 devstack sudo[89755]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.315s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:13 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Deleted volume successfully. Sep 18 00:34:13 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4961b677-d887-440c-8b55-da7452222caa tempest-VolumeQuotasNegativeTestJSON-992460240 None] Lock "cinder-add672d0-8c33-483c-85c6-a38139ab4b50-delete_volume" released by "delete_volume" :: held 1.986s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:13 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Flow 'volume_create_manager' (3668e63e-ede8-4181-881b-d136dbf4292a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ce9c7e-9393-4a18-95b9-b6b7d929493c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3ce9c7e-9393-4a18-95b9-b6b7d929493c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-359759992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77848b7a-d096-41ba-b39a-31d4ea9a2ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18c30a8b8b42bcb84863f3295c30bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:14Z,use_quota=True,user_id='c59c1211a56e46389fd12ca4d1017a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6c07e7-cc23-4b7b-b73c-d8701c1177da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d6c07e7-cc23-4b7b-b73c-d8701c1177da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9787d831-d873-4221-931d-0cb1fb40075b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9787d831-d873-4221-931d-0cb1fb40075b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77848b7a-d096-41ba-b39a-31d4ea9a2ad0', 'volume_name': 'volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f7d24c-7849-47a8-bcd7-8cdde703157a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (49f7d24c-7849-47a8-bcd7-8cdde703157a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbceaf92-ab41-46b0-bc04-45abeaf0a99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Volume 77848b7a-d096-41ba-b39a-31d4ea9a2ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0', 'volume_size': 1} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-359759992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77848b7a-d096-41ba-b39a-31d4ea9a2ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ea18c30a8b8b42bcb84863f3295c30bf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:14Z,use_quota=True,user_id='c59c1211a56e46389fd12ca4d1017a8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Creating volume 77848b7a-d096-41ba-b39a-31d4ea9a2ad0 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:14 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:14 devstack sudo[89759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 1073741824 Sep 18 00:34:14 devstack sudo[89759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:14 devstack sudo[89759]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 1073741824" returned: 0 in 0.713s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:14 devstack sudo[89766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 Sep 18 00:34:14 devstack sudo[89766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:15 devstack sudo[89766]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0" returned: 0 in 0.500s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] <== create_volume: return (1301ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.305s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbceaf92-ab41-46b0-bc04-45abeaf0a99f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10954e85-08b4-4d8f-b82a-a8d13ff95a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Volume volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 (77848b7a-d096-41ba-b39a-31d4ea9a2ad0): created successfully Sep 18 00:34:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (10954e85-08b4-4d8f-b82a-a8d13ff95a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Flow 'volume_create_manager' (3668e63e-ede8-4181-881b-d136dbf4292a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-88743fac-c8b0-4292-8f2b-9570ee76e92d tempest-VolumesAdminNegativeTest-1479856186 None] Created volume successfully. Sep 18 00:34:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-328a9e70-71f3-4f0b-9bb6-03a541a91563 req-8cfe837d-1907-4626-a652-5a54450842aa tempest-ServerActionsTestOtherA-1680223381 None] Terminate volume connection completed successfully. Sep 18 00:34:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-328a9e70-71f3-4f0b-9bb6-03a541a91563 req-8cfe837d-1907-4626-a652-5a54450842aa tempest-ServerActionsTestOtherA-1680223381 None] Deleting attachment 09e79d8a-46c5-4a20-a2d7-5ab201647079. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:34:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Acquiring lock "cinder-77848b7a-d096-41ba-b39a-31d4ea9a2ad0-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Lock "cinder-77848b7a-d096-41ba-b39a-31d4ea9a2ad0-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Acquiring lock "cinder-quobyte-77848b7a-d096-41ba-b39a-31d4ea9a2ad0" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Lock "cinder-quobyte-77848b7a-d096-41ba-b39a-31d4ea9a2ad0" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:17 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f5a94eb-ad94-4b3e-b036-d7d07e51ef51]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:17 devstack sudo[89773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 Sep 18 00:34:17 devstack sudo[89773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:18 devstack sudo[89773]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0" returned: 0 in 0.773s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:18 devstack sudo[89780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0 Sep 18 00:34:18 devstack sudo[89780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:18 devstack sudo[89780]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-77848b7a-d096-41ba-b39a-31d4ea9a2ad0" returned: 0 in 0.749s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Lock "cinder-quobyte-77848b7a-d096-41ba-b39a-31d4ea9a2ad0" released by "delete_volume" :: held 1.652s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Created reservations ['6cc0a6f7-4af4-4e6c-a3a3-22c487e623aa', '3835ad4f-da4b-4828-9098-3719e0d0a9d2', '81fe6397-869f-4e02-b1f9-c34b6304dca5', 'c3fe21c1-40bf-4cdd-ac60-26eb6f06a923'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:19 devstack sudo[89807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:19 devstack sudo[89807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:19 devstack sudo[89807]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.668s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:19 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Deleted volume successfully. Sep 18 00:34:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d93237e5-d7b1-43f4-9e06-677b0314f7b7 tempest-VolumesAdminNegativeTest-1479856186 None] Lock "cinder-77848b7a-d096-41ba-b39a-31d4ea9a2ad0-delete_volume" released by "delete_volume" :: held 2.878s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Flow 'volume_create_manager' (106c777d-0353-4928-a5a9-1ee3569a2fe6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca34f7e3-33f1-469d-a313-c6149c94cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ca34f7e3-33f1-469d-a313-c6149c94cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1167786526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d5218-aa2c-470c-8a96-b750e880f436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc5297bf17a47d7983b9463be07909d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:24Z,use_quota=True,user_id='ed19cba92538495dbbd67601158d4581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799489b7-fe2c-4333-876b-539b186b0549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (799489b7-fe2c-4333-876b-539b186b0549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd8c78f-13b2-4228-853f-b4f7264fca38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcd8c78f-13b2-4228-853f-b4f7264fca38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd34d5218-aa2c-470c-8a96-b750e880f436', 'volume_name': 'volume-d34d5218-aa2c-470c-8a96-b750e880f436', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39318ea6-cd79-4cbb-8f0f-807408deb465) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (39318ea6-cd79-4cbb-8f0f-807408deb465) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682541a8-2025-40cb-8f65-6ee9d0c5a5ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:24 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Volume d34d5218-aa2c-470c-8a96-b750e880f436: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d34d5218-aa2c-470c-8a96-b750e880f436', 'volume_size': 1} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1167786526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d34d5218-aa2c-470c-8a96-b750e880f436,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fc5297bf17a47d7983b9463be07909d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:24Z,use_quota=True,user_id='ed19cba92538495dbbd67601158d4581',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Creating volume d34d5218-aa2c-470c-8a96-b750e880f436 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:24 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:24 devstack sudo[89840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 1073741824 Sep 18 00:34:24 devstack sudo[89840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:25 devstack sudo[89840]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 1073741824" returned: 0 in 0.618s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:25 devstack sudo[89846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 Sep 18 00:34:25 devstack sudo[89846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:25 devstack sudo[89846]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Flow 'volume_create_manager' (ae812b7d-2d27-40a6-ba6d-6402baf8adcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0d98b-d0f4-4118-b0c9-010ed8fbb0d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436" returned: 0 in 0.346s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24e0d98b-d0f4-4118-b0c9-010ed8fbb0d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-924012410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7148528f-709f-459b-9912-406cc6ffebdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b437528d7940ecae98f8ca0b659a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:25Z,use_quota=True,user_id='3e15d8cf12194a4ea26bba26a7bd65c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca294ae5-53d2-46b7-8b42-1c6658745094) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca294ae5-53d2-46b7-8b42-1c6658745094) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f941300-7eb1-4ecc-9c04-394d3926f0ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (682541a8-2025-40cb-8f65-6ee9d0c5a5ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d34d5218-aa2c-470c-8a96-b750e880f436', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72603c9-b633-478c-b0f2-9544e81200e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Volume volume-d34d5218-aa2c-470c-8a96-b750e880f436 (d34d5218-aa2c-470c-8a96-b750e880f436): created successfully Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b72603c9-b633-478c-b0f2-9544e81200e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Flow 'volume_create_manager' (106c777d-0353-4928-a5a9-1ee3569a2fe6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a181a5d6-4042-4aa2-a7be-f158736d2556 tempest-VolumesServicesTestJSON-1520406108 None] Created volume successfully. Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Flow 'volume_create_manager' (804822f6-efcd-4dc8-b5cb-8ed1c94f821b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c255d3-8752-4d3c-88bf-a57d1857ce9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89c255d3-8752-4d3c-88bf-a57d1857ce9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-858938944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7646f2c1-5b55-41d1-94c0-099bced94cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e97bd6de524ce8801f1657dfa1ac72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:26Z,use_quota=True,user_id='c9608ad7bf6748eeaba7af5a8e7f9cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f42ffec-e76b-4d35-8be7-93ea51152935),volume_type_id=9f42ffec-e76b-4d35-8be7-93ea51152935)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422db864-f801-4f93-9ab8-7dcfec45faa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (422db864-f801-4f93-9ab8-7dcfec45faa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c06f10e-8b97-4193-b820-6e7056d73eb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c06f10e-8b97-4193-b820-6e7056d73eb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7646f2c1-5b55-41d1-94c0-099bced94cfd', 'volume_name': 'volume-7646f2c1-5b55-41d1-94c0-099bced94cfd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752c30ab-0d24-481c-89b7-c30af34de7a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (752c30ab-0d24-481c-89b7-c30af34de7a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139efdda-613a-46b5-b820-6ffe452700da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:26 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Volume 7646f2c1-5b55-41d1-94c0-099bced94cfd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7646f2c1-5b55-41d1-94c0-099bced94cfd', 'volume_size': 1} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-858938944',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7646f2c1-5b55-41d1-94c0-099bced94cfd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='57e97bd6de524ce8801f1657dfa1ac72',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:26Z,use_quota=True,user_id='c9608ad7bf6748eeaba7af5a8e7f9cbe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9f42ffec-e76b-4d35-8be7-93ea51152935),volume_type_id=9f42ffec-e76b-4d35-8be7-93ea51152935)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Creating volume 7646f2c1-5b55-41d1-94c0-099bced94cfd {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:26 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:26 devstack sudo[89850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd 1073741824 Sep 18 00:34:26 devstack sudo[89850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f941300-7eb1-4ecc-9c04-394d3926f0ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7148528f-709f-459b-9912-406cc6ffebdb', 'volume_name': 'volume-7148528f-709f-459b-9912-406cc6ffebdb', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7d79e7-6b94-4024-b42b-b2a66d899844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac7d79e7-6b94-4024-b42b-b2a66d899844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5644bf-e12d-409e-9d62-9bc760c8dadb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:26 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Volume 7148528f-709f-459b-9912-406cc6ffebdb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7148528f-709f-459b-9912-406cc6ffebdb', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Trying to clone 7148528f-709f-459b-9912-406cc6ffebdb from image 08c75831-54cd-415b-93ab-76883c9da538 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:34:26 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Image download 20.69 MB at 20.69 MB/s Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6fa0a3f-eae9-4d8f-8fcf-caa12911005d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Acquiring lock "cinder-d34d5218-aa2c-470c-8a96-b750e880f436-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:26 devstack sudo[89850]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd 1073741824" returned: 0 in 0.604s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Lock "cinder-d34d5218-aa2c-470c-8a96-b750e880f436-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:26 devstack sudo[89878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Acquiring lock "cinder-quobyte-d34d5218-aa2c-470c-8a96-b750e880f436" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:26 devstack sudo[89878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Lock "cinder-quobyte-d34d5218-aa2c-470c-8a96-b750e880f436" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:26 devstack sudo[89877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD Sep 18 00:34:26 devstack sudo[89877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4156b1d7-2a70-4e1c-81aa-a858f90a7fe7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:27 devstack sudo[89881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 Sep 18 00:34:27 devstack sudo[89881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:27 devstack sudo[89878]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] <== create_volume: return (990ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (139efdda-613a-46b5-b820-6ffe452700da) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7646f2c1-5b55-41d1-94c0-099bced94cfd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c605ae94-9872-4cfa-ade2-b51855791180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:27 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Volume volume-7646f2c1-5b55-41d1-94c0-099bced94cfd (7646f2c1-5b55-41d1-94c0-099bced94cfd): created successfully Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c605ae94-9872-4cfa-ade2-b51855791180) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:27 devstack sudo[89877]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Flow 'volume_create_manager' (804822f6-efcd-4dc8-b5cb-8ed1c94f821b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD" returned: 0 in 0.488s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 is fetched for user 3e15d8cf12194a4ea26bba26a7bd65c2. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:34:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7bb29e0f-5299-431f-b4e5-85bc8e4d37d9 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Created volume successfully. Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[45574054-22fe-494b-adeb-b631240b62b3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:27 devstack sudo[89881]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:27 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD Sep 18 00:34:27 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436" returned: 0 in 0.497s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:27 devstack sudo[89893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436 Sep 18 00:34:27 devstack sudo[89893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:27 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD" returned: 0 in 0.338s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-924012410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7148528f-709f-459b-9912-406cc6ffebdb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='78b437528d7940ecae98f8ca0b659a17',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:25Z,use_quota=True,user_id='3e15d8cf12194a4ea26bba26a7bd65c2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Creating volume 7148528f-709f-459b-9912-406cc6ffebdb {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:27 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:27 devstack sudo[89899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb 1073741824 Sep 18 00:34:27 devstack sudo[89899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:27 devstack sudo[89893]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d34d5218-aa2c-470c-8a96-b750e880f436" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Lock "cinder-quobyte-d34d5218-aa2c-470c-8a96-b750e880f436" released by "delete_volume" :: held 0.817s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Created reservations ['f7422ad3-24a8-4ccc-af23-9bbcc0ddd18c', '7b4a43fc-234d-4859-aadf-142cc3dea319', '7ceb9e2c-f31b-4cc2-ab81-0ba9d4feee76', '5885647c-ebb0-4f9c-92fe-404bab8fd148'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:27 devstack sudo[89901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:27 devstack sudo[89901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:28 devstack sudo[89901]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Deleted volume successfully. Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70d64260-c554-4d5e-b742-84737970893c tempest-VolumesServicesTestJSON-1520406108 None] Lock "cinder-d34d5218-aa2c-470c-8a96-b750e880f436-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:28 devstack sudo[89899]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb 1073741824" returned: 0 in 0.722s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:28 devstack sudo[89907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb Sep 18 00:34:28 devstack sudo[89907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:28 devstack sudo[89907]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb" returned: 0 in 0.359s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] <== create_volume: return (1135ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Attempting download of 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume 7148528f-709f-459b-9912-406cc6ffebdb. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4e090e03-3f04-4388-80bc-4267bd627f5f]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_hfdmigkt {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:28 devstack sudo[89910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:28 devstack sudo[89910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:28 devstack sudo[89911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_hfdmigkt Sep 18 00:34:28 devstack sudo[89911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:29 devstack sudo[89910]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.330s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-887d2ff9-fd2b-4c54-8323-cc47db2f9072 tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Retype volume completed successfully. Sep 18 00:34:29 devstack sudo[89911]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_hfdmigkt" returned: 0 in 0.438s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_hfdmigkt {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:29 devstack sudo[89918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_hfdmigkt Sep 18 00:34:29 devstack sudo[89918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:29 devstack sudo[89918]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_hfdmigkt" returned: 1 in 0.390s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_hfdmigkt' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ca7203-ec5d-40d9-9328-4b08867c0bc3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:29 devstack sudo[89922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD Sep 18 00:34:29 devstack sudo[89922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Acquiring lock "cinder-7646f2c1-5b55-41d1-94c0-099bced94cfd-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:30 devstack sudo[89922]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] 08c75831-54cd-415b-93ab-76883c9da538 was qcow2, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "cinder-7646f2c1-5b55-41d1-94c0-099bced94cfd-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:30 devstack sudo[89928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb Sep 18 00:34:30 devstack sudo[89928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Acquiring lock "cinder-quobyte-7646f2c1-5b55-41d1-94c0-099bced94cfd" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "cinder-quobyte-7646f2c1-5b55-41d1-94c0-099bced94cfd" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e423285-ed00-4474-862d-3a73f378da49]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:30 devstack sudo[89930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd Sep 18 00:34:30 devstack sudo[89930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:30 devstack sudo[89930]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd" returned: 0 in 0.513s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:30 devstack sudo[89940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd Sep 18 00:34:30 devstack sudo[89940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:31 devstack sudo[89940]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7646f2c1-5b55-41d1-94c0-099bced94cfd" returned: 0 in 0.333s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "cinder-quobyte-7646f2c1-5b55-41d1-94c0-099bced94cfd" released by "delete_volume" :: held 0.916s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:31 devstack cinder-volume[86526]: WARNING cinder.quota [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:34:31 devstack cinder-volume[86526]: WARNING cinder.quota [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Created reservations ['2ebf49dd-5a53-46f3-96e6-80b9b5dc6fc1', '876c1dc8-4804-444d-8d19-0895e70adeee', '6755b4b5-c4b3-4f7d-b1c1-142147445aad', '29c96856-c0a6-4b25-a7ea-f58fd3aea6d5'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:31 devstack sudo[89944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:31 devstack sudo[89944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:31 devstack sudo[89944]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.385s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Deleted volume successfully. Sep 18 00:34:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-379c9f9e-c5d1-4bd3-9ee7-d3602d99b0ea tempest-VolumeRetypeWithoutMigrationTest-1031172000 None] Lock "cinder-7646f2c1-5b55-41d1-94c0-099bced94cfd-delete_volume" released by "delete_volume" :: held 1.691s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:32 devstack sudo[89928]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb" returned: 0 in 2.589s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:32 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_cpkhxhqqdevstack@QuobyteHD, size 112.00 MB, duration 2.59 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:34:32 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Converted 112.00 MB image at 43.24 MB/s Sep 18 00:34:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:32 devstack sudo[89947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb 1G Sep 18 00:34:32 devstack sudo[89947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:33 devstack sudo[89947]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb 1G" returned: 0 in 0.399s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Downloaded image 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume 7148528f-709f-459b-9912-406cc6ffebdb successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 for user 3e15d8cf12194a4ea26bba26a7bd65c2 is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Marking volume 7148528f-709f-459b-9912-406cc6ffebdb as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Copying metadata from image 08c75831-54cd-415b-93ab-76883c9da538 to 7148528f-709f-459b-9912-406cc6ffebdb. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Creating volume glance metadata for volume 7148528f-709f-459b-9912-406cc6ffebdb backed by image 08c75831-54cd-415b-93ab-76883c9da538 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d5644bf-e12d-409e-9d62-9bc760c8dadb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7148528f-709f-459b-9912-406cc6ffebdb', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a8677a-9e58-4e40-8f20-902973700b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Volume volume-7148528f-709f-459b-9912-406cc6ffebdb (7148528f-709f-459b-9912-406cc6ffebdb): created successfully Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75a8677a-9e58-4e40-8f20-902973700b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Flow 'volume_create_manager' (ae812b7d-2d27-40a6-ba6d-6402baf8adcd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-57524189-b869-4884-86ac-943077425b10 tempest-ServerActionsTestOtherA-1680223381 None] Created volume successfully. Sep 18 00:34:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-2b700b8b-b44f-4e5a-b0e1-a547e67e9bb3 req-aa49da1e-b336-41bf-932e-ad9709f30755 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-2b700b8b-b44f-4e5a-b0e1-a547e67e9bb3 req-aa49da1e-b336-41bf-932e-ad9709f30755 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-2b700b8b-b44f-4e5a-b0e1-a547e67e9bb3 req-aa49da1e-b336-41bf-932e-ad9709f30755 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-2b700b8b-b44f-4e5a-b0e1-a547e67e9bb3 req-aa49da1e-b336-41bf-932e-ad9709f30755 tempest-ServerActionsTestOtherA-1680223381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-7148528f-709f-459b-9912-406cc6ffebdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1ed74f10-ec10-49ba-bbbd-e06dee06b4e4', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:34:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-2b700b8b-b44f-4e5a-b0e1-a547e67e9bb3 req-aa49da1e-b336-41bf-932e-ad9709f30755 tempest-ServerActionsTestOtherA-1680223381 None] attachment_update completed successfully. Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Flow 'volume_create_manager' (77864068-7cb6-4481-8e5c-febf5d56f68f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f06165-2338-4c4e-ab43-51813d9c5632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c9f06165-2338-4c4e-ab43-51813d9c5632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1350697183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351e014f-9a91-4fad-9cae-866664147e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c914f008e15a42f8b4b50c74c2976a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:41Z,use_quota=True,user_id='150ca7f7371c4e87810a36fbe6895918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f18bdb51-ac5c-411f-a5e4-1d3d45bcf848),volume_type_id=f18bdb51-ac5c-411f-a5e4-1d3d45bcf848)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d470c8f0-8bce-441a-955f-0ebbb09c4c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d470c8f0-8bce-441a-955f-0ebbb09c4c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd5807a-c85a-45e5-bd19-71c6ac366984) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5cd5807a-c85a-45e5-bd19-71c6ac366984) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '351e014f-9a91-4fad-9cae-866664147e07', 'volume_name': 'volume-351e014f-9a91-4fad-9cae-866664147e07', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe47a98-aec6-406f-b3c2-67cbaba5e108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (efe47a98-aec6-406f-b3c2-67cbaba5e108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aa64d7-4132-4012-9c85-ad130689a86a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:41 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Volume 351e014f-9a91-4fad-9cae-866664147e07: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-351e014f-9a91-4fad-9cae-866664147e07', 'volume_size': 1} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:34:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1350697183',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=351e014f-9a91-4fad-9cae-866664147e07,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c914f008e15a42f8b4b50c74c2976a02',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:34:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:34:41Z,use_quota=True,user_id='150ca7f7371c4e87810a36fbe6895918',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f18bdb51-ac5c-411f-a5e4-1d3d45bcf848),volume_type_id=f18bdb51-ac5c-411f-a5e4-1d3d45bcf848)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Creating volume 351e014f-9a91-4fad-9cae-866664147e07 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:34:41 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:34:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:41 devstack sudo[89978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 1073741824 Sep 18 00:34:41 devstack sudo[89978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:42 devstack sudo[89978]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 1073741824" returned: 0 in 0.742s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:42 devstack sudo[89985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 Sep 18 00:34:42 devstack sudo[89985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:42 devstack sudo[89985]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] <== create_volume: return (1200ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.203s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94aa64d7-4132-4012-9c85-ad130689a86a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-351e014f-9a91-4fad-9cae-866664147e07', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90370b56-fe0e-4c5f-b578-0cf0ba1afcd3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:34:42 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Volume volume-351e014f-9a91-4fad-9cae-866664147e07 (351e014f-9a91-4fad-9cae-866664147e07): created successfully Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90370b56-fe0e-4c5f-b578-0cf0ba1afcd3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:34:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Flow 'volume_create_manager' (77864068-7cb6-4481-8e5c-febf5d56f68f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:34:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5532310b-2c99-4398-9868-60da081a20dc tempest-VolumeTypesAccessTest-351126129 None] Created volume successfully. Sep 18 00:34:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Acquiring lock "cinder-351e014f-9a91-4fad-9cae-866664147e07-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Lock "cinder-351e014f-9a91-4fad-9cae-866664147e07-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Acquiring lock "cinder-quobyte-351e014f-9a91-4fad-9cae-866664147e07" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:34:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Lock "cinder-quobyte-351e014f-9a91-4fad-9cae-866664147e07" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:34:43 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[42b6af43-eb43-424f-81eb-27a14768cf2a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:34:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:43 devstack sudo[90437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 Sep 18 00:34:43 devstack sudo[90437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:44 devstack sudo[90437]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07" returned: 0 in 0.442s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:44 devstack sudo[90443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07 Sep 18 00:34:44 devstack sudo[90443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:44 devstack sudo[90443]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-351e014f-9a91-4fad-9cae-866664147e07" returned: 0 in 0.329s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Lock "cinder-quobyte-351e014f-9a91-4fad-9cae-866664147e07" released by "delete_volume" :: held 0.843s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:44 devstack cinder-volume[86526]: WARNING cinder.quota [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1625580634 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1625580634, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:34:44 devstack cinder-volume[86526]: WARNING cinder.quota [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1625580634 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1625580634, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Created reservations ['55fc0108-e62c-46fd-acd6-3e846fc652a7', '8fdab5d0-bb7e-4311-bb2d-ee201ff51cc4', 'ee54133b-7d70-46a5-bdcf-34d70e0ceef7', '28d9e6e4-d6fb-4a1e-aeaf-a94b1eda6db3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:34:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:34:44 devstack sudo[90448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:34:44 devstack sudo[90448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:34:45 devstack sudo[90448]: pam_unix(sudo:session): session closed for user root Sep 18 00:34:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.513s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:34:45 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:34:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Deleted volume successfully. Sep 18 00:34:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7d38ee04-cdf8-489d-aa95-c4039bf58818 tempest-VolumeTypesAccessTest-351126129 None] Lock "cinder-351e014f-9a91-4fad-9cae-866664147e07-delete_volume" released by "delete_volume" :: held 1.792s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:34:54 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=69,cinder:UPDATE=90,cinder:INSERT=18,cinder:DELETE=11 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:34:55 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=85,cinder:SELECT=78,cinder:INSERT=31,cinder:DELETE=4 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:04 devstack sudo[90549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:35:04 devstack sudo[90549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:04 devstack sudo[90549]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:35:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-88eb9f8c-9c20-4917-bbe7-4cb12473cfbe req-ef9d8ede-f5c1-43fc-a508-80a6cfea5672 tempest-ServerActionsTestOtherA-1680223381 None] Terminate volume connection completed successfully. Sep 18 00:35:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-88eb9f8c-9c20-4917-bbe7-4cb12473cfbe req-ef9d8ede-f5c1-43fc-a508-80a6cfea5672 tempest-ServerActionsTestOtherA-1680223381 None] Deleting attachment 1ed74f10-ec10-49ba-bbbd-e06dee06b4e4. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:35:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-88eb9f8c-9c20-4917-bbe7-4cb12473cfbe req-47d6e0a6-5178-4a01-b495-964a143a73c1 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-88eb9f8c-9c20-4917-bbe7-4cb12473cfbe req-47d6e0a6-5178-4a01-b495-964a143a73c1 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-88eb9f8c-9c20-4917-bbe7-4cb12473cfbe req-47d6e0a6-5178-4a01-b495-964a143a73c1 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.041s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-88eb9f8c-9c20-4917-bbe7-4cb12473cfbe req-47d6e0a6-5178-4a01-b495-964a143a73c1 tempest-ServerActionsTestOtherA-1680223381 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-7148528f-709f-459b-9912-406cc6ffebdb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b2316a3f-99cf-4940-9e5a-99e63ee1371e', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:35:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-88eb9f8c-9c20-4917-bbe7-4cb12473cfbe req-47d6e0a6-5178-4a01-b495-964a143a73c1 tempest-ServerActionsTestOtherA-1680223381 None] attachment_update completed successfully. Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Flow 'volume_create_manager' (39d819f7-8345-4286-9e07-e681e06361f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5089cfc8-0e1c-4b2b-aa43-2554d6885537) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5089cfc8-0e1c-4b2b-aa43-2554d6885537) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1433326992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cf0a93-4ac5-4424-9efb-3fb7362f0389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5b8f70009649e6ac967e0de180f5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:25Z,use_quota=True,user_id='28fbf8073a0041308c9c98ffd93d0861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdffdc2c-7fb1-4047-858c-455a25a9eb02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bdffdc2c-7fb1-4047-858c-455a25a9eb02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e989ebca-9e60-43d3-9fe9-2cfc9e0479cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e989ebca-9e60-43d3-9fe9-2cfc9e0479cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c7cf0a93-4ac5-4424-9efb-3fb7362f0389', 'volume_name': 'volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ef75ac-b5e1-4451-8987-a5b18b39484f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9ef75ac-b5e1-4451-8987-a5b18b39484f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02070ddc-5ed1-4ee1-a935-2d407f5facce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Volume c7cf0a93-4ac5-4424-9efb-3fb7362f0389: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389', 'volume_size': 1} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1433326992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c7cf0a93-4ac5-4424-9efb-3fb7362f0389,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c5b8f70009649e6ac967e0de180f5c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:25Z,use_quota=True,user_id='28fbf8073a0041308c9c98ffd93d0861',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Creating volume c7cf0a93-4ac5-4424-9efb-3fb7362f0389 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:35:25 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:35:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:25 devstack sudo[91061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 1073741824 Sep 18 00:35:25 devstack sudo[91061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:26 devstack sudo[91061]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 1073741824" returned: 0 in 0.975s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:26 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 Sep 18 00:35:26 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:26 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389" returned: 0 in 0.332s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] <== create_volume: return (1365ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.375s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02070ddc-5ed1-4ee1-a935-2d407f5facce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1f61b0-3e83-4019-807c-d936d1646937) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:26 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Volume volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 (c7cf0a93-4ac5-4424-9efb-3fb7362f0389): created successfully Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c1f61b0-3e83-4019-807c-d936d1646937) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Flow 'volume_create_manager' (39d819f7-8345-4286-9e07-e681e06361f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:26 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e794555a-6bd5-4e4b-9e91-b70a5772c20e tempest-TaggedAttachmentsTest-1343216865 None] Created volume successfully. Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (b7d2061f-8f0d-4388-acdb-4c5e04165708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5750e355-24d2-4a41-b82a-a15822b3b4b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5750e355-24d2-4a41-b82a-a15822b3b4b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1125883803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46183645-c134-44f2-aac9-84f9269d31bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:36Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07578d-9a19-4fca-ae3e-b5532ecef9b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d07578d-9a19-4fca-ae3e-b5532ecef9b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2820f2-d348-4965-8eeb-6d0c0f26f9cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac2820f2-d348-4965-8eeb-6d0c0f26f9cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '46183645-c134-44f2-aac9-84f9269d31bb', 'volume_name': 'volume-46183645-c134-44f2-aac9-84f9269d31bb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b345b7-3eba-447d-92c4-23176daac73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04b345b7-3eba-447d-92c4-23176daac73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4996987-4597-4813-b709-995899b41a1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:36 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Volume 46183645-c134-44f2-aac9-84f9269d31bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-46183645-c134-44f2-aac9-84f9269d31bb', 'volume_size': 1} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1125883803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=46183645-c134-44f2-aac9-84f9269d31bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:36Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Creating volume 46183645-c134-44f2-aac9-84f9269d31bb {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:35:36 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:35:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:36 devstack sudo[91167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb 1073741824 Sep 18 00:35:36 devstack sudo[91167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:37 devstack sudo[91167]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb 1073741824" returned: 0 in 1.017s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:37 devstack sudo[91175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb Sep 18 00:35:37 devstack sudo[91175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:38 devstack sudo[91175]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb" returned: 0 in 0.809s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] <== create_volume: return (1994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:35:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.998s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e4996987-4597-4813-b709-995899b41a1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-46183645-c134-44f2-aac9-84f9269d31bb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc770d82-56e0-477d-b54d-62eefe6e3b69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:38 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Volume volume-46183645-c134-44f2-aac9-84f9269d31bb (46183645-c134-44f2-aac9-84f9269d31bb): created successfully Sep 18 00:35:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc770d82-56e0-477d-b54d-62eefe6e3b69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (b7d2061f-8f0d-4388-acdb-4c5e04165708) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8b8dce1b-0895-423d-84ad-c93a7cea427e tempest-VolumesActionsTest-1175847581 None] Created volume successfully. Sep 18 00:35:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c99e67b-e7d4-4550-bf81-b5b34ae3c537 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb" by "attach_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c99e67b-e7d4-4550-bf81-b5b34ae3c537 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb" acquired by "attach_volume" :: waited 0.038s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c99e67b-e7d4-4550-bf81-b5b34ae3c537 tempest-VolumesActionsTest-1175847581 None] Attaching volume 46183645-c134-44f2-aac9-84f9269d31bb to instance 34689592-10b0-4383-8c0c-8b7604517b01 at mountpoint /dev/vdb on host None. Sep 18 00:35:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c99e67b-e7d4-4550-bf81-b5b34ae3c537 tempest-VolumesActionsTest-1175847581 None] Attach volume completed successfully. Sep 18 00:35:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c99e67b-e7d4-4550-bf81-b5b34ae3c537 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb" released by "attach_volume" :: held 0.207s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-259cea7a-ed6a-4877-900b-70661c96bf42 tempest-VolumesActionsTest-1784712139 None] Terminate volume connection completed successfully. Sep 18 00:35:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-259cea7a-ed6a-4877-900b-70661c96bf42 tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-detach_volume" by "detach_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-259cea7a-ed6a-4877-900b-70661c96bf42 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-detach_volume" acquired by "detach_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-259cea7a-ed6a-4877-900b-70661c96bf42 tempest-VolumesActionsTest-1784712139 None] Detaching volume 46183645-c134-44f2-aac9-84f9269d31bb from instance 34689592-10b0-4383-8c0c-8b7604517b01. Sep 18 00:35:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-259cea7a-ed6a-4877-900b-70661c96bf42 tempest-VolumesActionsTest-1784712139 None] Detach volume completed successfully. Sep 18 00:35:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-259cea7a-ed6a-4877-900b-70661c96bf42 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-detach_volume" released by "detach_volume" :: held 0.107s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-392dfecf-60ab-4e11-a1a7-b9b6aa6125f5 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-detach_volume" by "detach_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-392dfecf-60ab-4e11-a1a7-b9b6aa6125f5 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-detach_volume" acquired by "detach_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-392dfecf-60ab-4e11-a1a7-b9b6aa6125f5 tempest-VolumesActionsTest-1175847581 None] Volume detach called, but volume not attached. Sep 18 00:35:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-392dfecf-60ab-4e11-a1a7-b9b6aa6125f5 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-detach_volume" released by "detach_volume" :: held 0.028s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "cinder-quobyte-46183645-c134-44f2-aac9-84f9269d31bb" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-quobyte-46183645-c134-44f2-aac9-84f9269d31bb" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:42 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4652170-b86f-4989-967c-23dcb8b5183a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:35:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:42 devstack sudo[91198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb Sep 18 00:35:42 devstack sudo[91198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:43 devstack sudo[91198]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb" returned: 0 in 0.884s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:43 devstack sudo[91204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb Sep 18 00:35:43 devstack sudo[91204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:44 devstack sudo[91204]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-46183645-c134-44f2-aac9-84f9269d31bb" returned: 0 in 1.135s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-quobyte-46183645-c134-44f2-aac9-84f9269d31bb" released by "delete_volume" :: held 2.195s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Created reservations ['3aa7d89d-d5d1-48ae-855d-b3990f00c798', 'a3209758-5c2f-4a14-bc59-412b7d6bf9ab', '1c0e5b3a-55c4-4f4c-adfb-f959589cb6ec', 'a7f16f32-d107-4a81-a5ac-ef500ba8af82'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:44 devstack sudo[91276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:35:44 devstack sudo[91276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:45 devstack sudo[91276]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.973s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:45 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:35:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Deleted volume successfully. Sep 18 00:35:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a313effa-12b4-4f1c-b0a4-ab19a5d89231 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-46183645-c134-44f2-aac9-84f9269d31bb-delete_volume" released by "delete_volume" :: held 3.701s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (667f5c4c-cb67-4d03-aa16-1e84893855f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ab0135-f955-4398-b0d9-eeba467c629a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1ab0135-f955-4398-b0d9-eeba467c629a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1069752232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:50Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c927319b-6563-4af4-a4bb-045e230c72eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c927319b-6563-4af4-a4bb-045e230c72eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d0a262-ca00-47a4-96ee-040d209b3d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92d0a262-ca00-47a4-96ee-040d209b3d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04', 'volume_name': 'volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3f5c50-0dce-4594-98c6-4f1264af52db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a3f5c50-0dce-4594-98c6-4f1264af52db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9741df3-2b0e-4126-bcbd-4bbbc05419c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:50 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Volume 97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04', 'volume_size': 1} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1069752232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:50Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Creating volume 97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:35:50 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:35:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:50 devstack sudo[91359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 1073741824 Sep 18 00:35:50 devstack sudo[91359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:51 devstack sudo[91359]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 1073741824" returned: 0 in 0.576s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:51 devstack sudo[91367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 Sep 18 00:35:51 devstack sudo[91367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:51 devstack sudo[91367]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04" returned: 0 in 0.316s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.953s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9741df3-2b0e-4126-bcbd-4bbbc05419c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1f7e38-e206-4311-907e-f50291a8c132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:51 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Volume volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 (97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04): created successfully Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb1f7e38-e206-4311-907e-f50291a8c132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (667f5c4c-cb67-4d03-aa16-1e84893855f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-203dfad6-602a-411c-a445-85d02fea715a tempest-VolumesActionsTest-1175847581 None] Created volume successfully. Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Flow 'volume_create_manager' (2e8fe7e9-19a9-4c68-8779-3d21f9f89ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b6e702-f5a3-4f84-8020-a5743c5f757a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19b6e702-f5a3-4f84-8020-a5743c5f757a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1957446098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ec4759-4be7-48a2-8aca-8cef1de07b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ad73007cf946f99f5b13c61789094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:52Z,use_quota=True,user_id='ae89bca929a84824bb44ab57021f9f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfe14be-da37-4841-95e2-193fed60b0b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bfe14be-da37-4841-95e2-193fed60b0b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b670f310-bda3-4e06-bc72-ab86dcb0394c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b670f310-bda3-4e06-bc72-ab86dcb0394c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8ec4759-4be7-48a2-8aca-8cef1de07b96', 'volume_name': 'volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c601e1-c97d-4e91-9bf9-747f3b41c33b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28c601e1-c97d-4e91-9bf9-747f3b41c33b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d831fef1-ca5e-48be-b6b1-956f87726944) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:52 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Volume d8ec4759-4be7-48a2-8aca-8cef1de07b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96', 'volume_size': 1} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1957446098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8ec4759-4be7-48a2-8aca-8cef1de07b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='24ad73007cf946f99f5b13c61789094f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:52Z,use_quota=True,user_id='ae89bca929a84824bb44ab57021f9f1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Creating volume d8ec4759-4be7-48a2-8aca-8cef1de07b96 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:35:52 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:52 devstack sudo[91371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 1073741824 Sep 18 00:35:52 devstack sudo[91371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-quobyte-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5002bec6-bd66-4df3-b639-33d46812e1f8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:35:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:53 devstack sudo[91373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 Sep 18 00:35:53 devstack sudo[91373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:53 devstack sudo[91371]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 1073741824" returned: 0 in 0.658s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04" returned: 0 in 0.514s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:53 devstack sudo[91373]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:53 devstack sudo[91383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 Sep 18 00:35:53 devstack sudo[91383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:53 devstack sudo[91384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04 Sep 18 00:35:53 devstack sudo[91384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:53 devstack sudo[91383]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96" returned: 0 in 0.359s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] <== create_volume: return (1080ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:53 devstack sudo[91384]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d831fef1-ca5e-48be-b6b1-956f87726944) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605b559c-59d0-4ae7-b02a-51222781a3f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04" returned: 0 in 0.353s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04" released by "delete_volume" :: held 0.923s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:53 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Volume volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 (d8ec4759-4be7-48a2-8aca-8cef1de07b96): created successfully Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (605b559c-59d0-4ae7-b02a-51222781a3f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Flow 'volume_create_manager' (2e8fe7e9-19a9-4c68-8779-3d21f9f89ba5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8e9e4e92-6410-4cc1-a41a-6234f13fe38e tempest-AbsoluteLimitsTests-1179313113 None] Created volume successfully. Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Created reservations ['4c890d28-93f8-4a8f-9fdc-f5e5a1763c6e', 'c13066a0-bff6-4344-8efa-f5e1d20777bc', 'a6208f4f-0a20-4dee-a9ca-8a838f90b81b', '805ba2e9-acf0-45e6-929f-e20598512ace'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:53 devstack sudo[91390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:35:53 devstack sudo[91390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:54 devstack sudo[91390]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.327s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:35:54 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Deleted volume successfully. Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fab54fd-6858-4dea-8805-df722cf9a663 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-97e4a3ea-f8d9-4fbf-b80e-04f45cda3b04-delete_volume" released by "delete_volume" :: held 1.579s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Acquiring lock "cinder-d8ec4759-4be7-48a2-8aca-8cef1de07b96-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Lock "cinder-d8ec4759-4be7-48a2-8aca-8cef1de07b96-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Acquiring lock "cinder-quobyte-d8ec4759-4be7-48a2-8aca-8cef1de07b96" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Lock "cinder-quobyte-d8ec4759-4be7-48a2-8aca-8cef1de07b96" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0b96a03-ea22-44a0-99fd-21ba302351af]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:35:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:55 devstack sudo[91428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 Sep 18 00:35:55 devstack sudo[91428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:55 devstack sudo[91428]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96" returned: 0 in 0.459s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:55 devstack sudo[91434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96 Sep 18 00:35:55 devstack sudo[91434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:55 devstack sudo[91434]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d8ec4759-4be7-48a2-8aca-8cef1de07b96" returned: 0 in 0.332s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Lock "cinder-quobyte-d8ec4759-4be7-48a2-8aca-8cef1de07b96" released by "delete_volume" :: held 0.863s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (91067497-f937-4922-a662-d5507ab47e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb49e435-6c87-4e3b-a57b-7c9c519a345d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb49e435-6c87-4e3b-a57b-7c9c519a345d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-879393530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5016052c-1999-4e02-856a-2ee70d6e0df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:56Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff7af75-2020-4043-8b66-06d09da1df30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fff7af75-2020-4043-8b66-06d09da1df30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59054b7-9434-4a03-b542-fbfd674f7e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c59054b7-9434-4a03-b542-fbfd674f7e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5016052c-1999-4e02-856a-2ee70d6e0df3', 'volume_name': 'volume-5016052c-1999-4e02-856a-2ee70d6e0df3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb0462f-3ad7-4f9f-8f9b-9af1d98ab971) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3bb0462f-3ad7-4f9f-8f9b-9af1d98ab971) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31569763-1969-4c9c-82d3-882c9d9b09d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:55 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Volume 5016052c-1999-4e02-856a-2ee70d6e0df3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5016052c-1999-4e02-856a-2ee70d6e0df3', 'volume_size': 1} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:35:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-879393530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5016052c-1999-4e02-856a-2ee70d6e0df3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:35:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:35:56Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Creating volume 5016052c-1999-4e02-856a-2ee70d6e0df3 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:35:55 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:55 devstack sudo[91437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 1073741824 Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Created reservations ['c2b44940-a6af-4dad-b2ba-0821b60e8104', 'b84721ce-a5fa-4eed-9d02-cb081b1621af', '7d8a8381-912b-4619-9557-ed31c82f2eb3', '051c5587-f3c5-4926-9aac-72c6eb9fc7ed'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:35:55 devstack sudo[91437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:56 devstack sudo[91439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:35:56 devstack sudo[91439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:56 devstack sudo[91439]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:56 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:35:56 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Deleted volume successfully. Sep 18 00:35:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ece1af2-a215-445a-899d-42a0077f653a tempest-AbsoluteLimitsTests-1179313113 None] Lock "cinder-d8ec4759-4be7-48a2-8aca-8cef1de07b96-delete_volume" released by "delete_volume" :: held 1.612s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:56 devstack sudo[91437]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 1073741824" returned: 0 in 0.729s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:56 devstack sudo[91447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 Sep 18 00:35:56 devstack sudo[91447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:57 devstack sudo[91447]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] <== create_volume: return (1185ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:35:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.187s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31569763-1969-4c9c-82d3-882c9d9b09d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5016052c-1999-4e02-856a-2ee70d6e0df3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa889b98-e056-49d6-be59-b377e2c6f0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:35:57 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Volume volume-5016052c-1999-4e02-856a-2ee70d6e0df3 (5016052c-1999-4e02-856a-2ee70d6e0df3): created successfully Sep 18 00:35:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (aa889b98-e056-49d6-be59-b377e2c6f0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:35:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (91067497-f937-4922-a662-d5507ab47e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:35:57 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a601542a-9695-415f-8a1c-455c1265fe8c tempest-VolumesActionsTest-1175847581 None] Created volume successfully. Sep 18 00:35:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-5016052c-1999-4e02-856a-2ee70d6e0df3-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-5016052c-1999-4e02-856a-2ee70d6e0df3-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-quobyte-5016052c-1999-4e02-856a-2ee70d6e0df3" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:35:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-5016052c-1999-4e02-856a-2ee70d6e0df3" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:35:58 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[91bf3763-db16-4352-b986-7b9d9f0db3dd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:35:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:58 devstack sudo[91476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 Sep 18 00:35:58 devstack sudo[91476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:59 devstack sudo[91476]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3" returned: 0 in 0.577s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:59 devstack sudo[91483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3 Sep 18 00:35:59 devstack sudo[91483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:59 devstack sudo[91483]: pam_unix(sudo:session): session closed for user root Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5016052c-1999-4e02-856a-2ee70d6e0df3" returned: 0 in 0.411s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-5016052c-1999-4e02-856a-2ee70d6e0df3" released by "delete_volume" :: held 1.050s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Created reservations ['b0fc4d0f-d280-4b61-8e92-df51439922dd', '5106947b-4e9a-4b49-8e20-f8fed954f840', '0f9e6280-2325-417f-a866-31de90873001', 'b005202a-da76-4e48-9e0c-6de285457ab7'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:35:59 devstack sudo[91489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:35:59 devstack sudo[91489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:35:59 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-a6f82f30-0ed6-46b9-8133-f685ae71d0e3 tempest-ServerActionsTestOtherA-1680223381 None] Terminate volume connection completed successfully. Sep 18 00:35:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-a6f82f30-0ed6-46b9-8133-f685ae71d0e3 tempest-ServerActionsTestOtherA-1680223381 None] Deleting attachment b2316a3f-99cf-4940-9e5a-99e63ee1371e. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "cinder-7148528f-709f-459b-9912-406cc6ffebdb-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:00 devstack sudo[91489]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.408s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-7148528f-709f-459b-9912-406cc6ffebdb-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Deleted volume successfully. Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-908c6a5d-8141-415e-aaf5-602e1a199a01 tempest-VolumesActionsTest-1784712139 None] Lock "cinder-5016052c-1999-4e02-856a-2ee70d6e0df3-delete_volume" released by "delete_volume" :: held 1.922s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "cinder-quobyte-7148528f-709f-459b-9912-406cc6ffebdb" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-quobyte-7148528f-709f-459b-9912-406cc6ffebdb" acquired by "delete_volume" :: waited 0.046s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfd3dd92-df4a-4bef-832f-fbf028efa33f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:00 devstack sudo[91532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb Sep 18 00:36:00 devstack sudo[91532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:01 devstack sudo[91532]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb" returned: 0 in 0.723s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:01 devstack sudo[91537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb Sep 18 00:36:01 devstack sudo[91537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:01 devstack sudo[91537]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7148528f-709f-459b-9912-406cc6ffebdb" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-quobyte-7148528f-709f-459b-9912-406cc6ffebdb" released by "delete_volume" :: held 1.097s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.quota [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Created reservations ['74c8d252-def0-41ca-a9c8-fa0aa75c1618', 'a7345544-687d-4a98-9f2f-63227bbc124c', '75d3c408-cde8-4b04-be7a-9817469c9a7b', 'fbf5b88a-b93e-42fa-9e1e-0ddd60682219'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:01 devstack sudo[91541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:01 devstack sudo[91541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (101f60aa-4473-4540-8be4-347f651d8334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e77079-9e31-464e-a513-29ce045986a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a1e77079-9e31-464e-a513-29ce045986a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2094802965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0543be92-5671-4616-83a0-723d2be1caeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:01Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c8473-25ed-4550-a22b-7afe46e8d6f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba6c8473-25ed-4550-a22b-7afe46e8d6f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad524a4c-d9d2-462a-8823-c8bb5ef42be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad524a4c-d9d2-462a-8823-c8bb5ef42be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0543be92-5671-4616-83a0-723d2be1caeb', 'volume_name': 'volume-0543be92-5671-4616-83a0-723d2be1caeb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60acb84c-9f70-49a4-94d4-72ad166c02d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60acb84c-9f70-49a4-94d4-72ad166c02d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb820342-133c-459f-8456-d1add816bda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:01 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Volume 0543be92-5671-4616-83a0-723d2be1caeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0543be92-5671-4616-83a0-723d2be1caeb', 'volume_size': 1} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2094802965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0543be92-5671-4616-83a0-723d2be1caeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:01Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Creating volume 0543be92-5671-4616-83a0-723d2be1caeb {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:01 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:01 devstack sudo[91543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb 1073741824 Sep 18 00:36:01 devstack sudo[91543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:01 devstack sudo[91541]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.299s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.manager [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:01 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Deleted volume successfully. Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-b4ddd419-efa2-4a3d-858d-ec258346e191 req-1d30a6bc-c335-4707-82af-a6fff9d9389e tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-7148528f-709f-459b-9912-406cc6ffebdb-delete_volume" released by "delete_volume" :: held 1.757s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "cinder-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "cinder-quobyte-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-quobyte-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0a1b513-0337-4cc0-b0b3-5a058dbb05e9]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:02 devstack sudo[91549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 Sep 18 00:36:02 devstack sudo[91549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:02 devstack sudo[91543]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb 1073741824" returned: 0 in 0.540s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:02 devstack sudo[91552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb Sep 18 00:36:02 devstack sudo[91552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:02 devstack sudo[91549]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8" returned: 0 in 0.393s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:02 devstack sudo[91557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8 Sep 18 00:36:02 devstack sudo[91557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:02 devstack sudo[91552]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb" returned: 0 in 0.298s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] <== create_volume: return (886ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.889s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb820342-133c-459f-8456-d1add816bda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0543be92-5671-4616-83a0-723d2be1caeb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d58bc93-1a7d-41c6-b544-8ff344fcd82d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:02 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Volume volume-0543be92-5671-4616-83a0-723d2be1caeb (0543be92-5671-4616-83a0-723d2be1caeb): created successfully Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d58bc93-1a7d-41c6-b544-8ff344fcd82d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (101f60aa-4473-4540-8be4-347f651d8334) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:02 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-bf7ff85f-5358-4c13-92e4-68668b2e0140 tempest-VolumesActionsTest-1175847581 None] Created volume successfully. Sep 18 00:36:02 devstack sudo[91557]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8" returned: 0 in 0.269s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-quobyte-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8" released by "delete_volume" :: held 0.713s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Created reservations ['05564743-697b-48c4-b3c3-9acae1f28d0f', '40b9bc4c-e172-41c8-89f3-0de3f897783d', '9ef38ec1-0e74-4535-8b28-e34974dda7d8', 'f9f65446-af12-4243-b40c-89ede592a2ed'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:02 devstack sudo[91561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:02 devstack sudo[91561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:03 devstack sudo[91561]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:03 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:03 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Deleted volume successfully. Sep 18 00:36:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7ab60e68-5ffb-414e-bdb5-5a3d42875156 tempest-ServerActionsTestOtherA-1680223381 None] Lock "cinder-f4174f06-dbd7-4f31-a6c2-236e0aca9cc8-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (a3cdfa9b-00bd-4c99-a7d7-5ad64b078a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30409985-3649-40ac-bd63-50b606db0186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-0543be92-5671-4616-83a0-723d2be1caeb-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (30409985-3649-40ac-bd63-50b606db0186) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2087387117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d6f113-5f61-47d1-a4ed-f1a4ce57a800,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:04Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50929236-48f2-44ca-b2d9-b4a19d22faf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50929236-48f2-44ca-b2d9-b4a19d22faf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc5440a-7716-4c46-a4a8-a4af8e804b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cfc5440a-7716-4c46-a4a8-a4af8e804b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '71d6f113-5f61-47d1-a4ed-f1a4ce57a800', 'volume_name': 'volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5e3ae4-4f11-4961-a3f2-2abd8dda80a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f5e3ae4-4f11-4961-a3f2-2abd8dda80a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c35b33-7b85-4724-a0cd-f7e36509618d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:04 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Volume 71d6f113-5f61-47d1-a4ed-f1a4ce57a800: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800', 'volume_size': 1} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2087387117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=71d6f113-5f61-47d1-a4ed-f1a4ce57a800,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:04Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Creating volume 71d6f113-5f61-47d1-a4ed-f1a4ce57a800 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:04 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Lock "cinder-0543be92-5671-4616-83a0-723d2be1caeb-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:04 devstack sudo[91588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 1073741824 Sep 18 00:36:04 devstack sudo[91588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-quobyte-0543be92-5671-4616-83a0-723d2be1caeb" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-0543be92-5671-4616-83a0-723d2be1caeb" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a2048b0-8a20-4440-9ea8-cb60baef9432]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:04 devstack sudo[91593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:04 devstack sudo[91593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:04 devstack sudo[91590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb Sep 18 00:36:04 devstack sudo[91590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:04 devstack sudo[91588]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:04 devstack sudo[91593]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 1073741824" returned: 0 in 0.597s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.387s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:04 devstack sudo[91590]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb" returned: 0 in 0.523s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:04 devstack sudo[91604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb Sep 18 00:36:04 devstack sudo[91604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:04 devstack sudo[91603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 Sep 18 00:36:04 devstack sudo[91603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:05 devstack sudo[91604]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0543be92-5671-4616-83a0-723d2be1caeb" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:05 devstack sudo[91603]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800" returned: 0 in 0.337s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-0543be92-5671-4616-83a0-723d2be1caeb" released by "delete_volume" :: held 0.891s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53c35b33-7b85-4724-a0cd-f7e36509618d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1215776-d0ba-4d55-9a14-4d9fcb92b60e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:05 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Volume volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 (71d6f113-5f61-47d1-a4ed-f1a4ce57a800): created successfully Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1215776-d0ba-4d55-9a14-4d9fcb92b60e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (a3cdfa9b-00bd-4c99-a7d7-5ad64b078a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:05 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e3dd6653-4e84-404f-941c-b8989412fa59 tempest-VolumesGetTest-103664594 None] Created volume successfully. Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Created reservations ['253d8b82-89d5-4dd8-939b-83cb0c1361e8', '8577e83f-7543-428b-a0e4-12de1374c40a', '4d0c5be3-f2da-4a97-89fb-37a2b13f7cf3', 'fdad7d3b-19f8-475f-a55c-54784ea50ff0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:05 devstack sudo[91610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:05 devstack sudo[91610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:05 devstack sudo[91610]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.277s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:05 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Deleted volume successfully. Sep 18 00:36:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b869e50d-3569-4c40-b3b9-a4b8194a61ad tempest-VolumesActionsTest-1784712139 None] Lock "cinder-0543be92-5671-4616-83a0-723d2be1caeb-delete_volume" released by "delete_volume" :: held 1.457s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:06 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (2f7f6f76-d98c-423a-ac5c-6b947b350c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e1221-791d-469c-9871-d78d3aceadf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (575e1221-791d-469c-9871-d78d3aceadf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-716603163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfb6c47-ad51-46f9-a9a5-0b21f5a58934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:07Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6752ffc7-92a3-4daf-941e-07244c096f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6752ffc7-92a3-4daf-941e-07244c096f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f0acfb-28d2-4b63-9fc7-4d20c09658f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13f0acfb-28d2-4b63-9fc7-4d20c09658f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4cfb6c47-ad51-46f9-a9a5-0b21f5a58934', 'volume_name': 'volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eadfcc-09b9-40f2-a7cd-b95f9cd9f6ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (40eadfcc-09b9-40f2-a7cd-b95f9cd9f6ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec8d25-da6f-4579-96dd-b23870184496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Volume 4cfb6c47-ad51-46f9-a9a5-0b21f5a58934: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934', 'volume_size': 1} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-716603163',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4cfb6c47-ad51-46f9-a9a5-0b21f5a58934,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:07Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Creating volume 4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:07 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:07 devstack sudo[91614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 1073741824 Sep 18 00:36:07 devstack sudo[91614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (999a71bd-41c6-4bac-8862-85bab2d143db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e773f7d-4df1-45c9-be40-57dd93f0bcc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2e773f7d-4df1-45c9-be40-57dd93f0bcc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1824293393',display_name='tempest-VolumesGetTest-Volume-326593988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da852a24-d96a-41d3-ad0c-17dc37d60f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:07Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588cfe13-29c9-4859-adf1-3f79fb0d95a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (588cfe13-29c9-4859-adf1-3f79fb0d95a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85fba0f-ece3-4d66-a08f-39b8e10f23aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e85fba0f-ece3-4d66-a08f-39b8e10f23aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da852a24-d96a-41d3-ad0c-17dc37d60f0f', 'volume_name': 'volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f036a9e6-078e-451c-ab33-5781f237f58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f036a9e6-078e-451c-ab33-5781f237f58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5696ed2a-ff30-4dd5-ad96-29ceda75b0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Volume da852a24-d96a-41d3-ad0c-17dc37d60f0f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f', 'volume_size': 1} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:07 devstack sudo[91614]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 1073741824" returned: 0 in 0.488s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:07 devstack sudo[91621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 Sep 18 00:36:07 devstack sudo[91621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:07 devstack sudo[91621]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934" returned: 0 in 0.297s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.656s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:07Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1824293393',display_name='tempest-VolumesGetTest-Volume-326593988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da852a24-d96a-41d3-ad0c-17dc37d60f0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:07Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Creating volume da852a24-d96a-41d3-ad0c-17dc37d60f0f {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:07 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdec8d25-da6f-4579-96dd-b23870184496) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c53f238-ab1b-4233-b708-f9e9e25a0439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:07 devstack sudo[91624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f 1073741824 Sep 18 00:36:07 devstack sudo[91624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Volume volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 (4cfb6c47-ad51-46f9-a9a5-0b21f5a58934): created successfully Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9c53f238-ab1b-4233-b708-f9e9e25a0439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (2f7f6f76-d98c-423a-ac5c-6b947b350c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:07 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e131921b-e3ec-49c3-b024-98c76d8f70fa tempest-VolumesActionsTest-1175847581 None] Created volume successfully. Sep 18 00:36:08 devstack sudo[91624]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f 1073741824" returned: 0 in 0.556s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:08 devstack sudo[91631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f Sep 18 00:36:08 devstack sudo[91631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:08 devstack sudo[91631]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5696ed2a-ff30-4dd5-ad96-29ceda75b0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a252250-8398-409f-84f6-e64be9d68f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:08 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Volume volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f (da852a24-d96a-41d3-ad0c-17dc37d60f0f): created successfully Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a252250-8398-409f-84f6-e64be9d68f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (999a71bd-41c6-4bac-8862-85bab2d143db) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:08 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-bfd5cdc7-42a8-4e31-8384-e91b5ceb5c3e tempest-VolumesGetTest-103664594 None] Created volume successfully. Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-da852a24-d96a-41d3-ad0c-17dc37d60f0f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Lock "cinder-da852a24-d96a-41d3-ad0c-17dc37d60f0f-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Lock "cinder-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Acquiring lock "cinder-quobyte-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-da852a24-d96a-41d3-ad0c-17dc37d60f0f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-da852a24-d96a-41d3-ad0c-17dc37d60f0f" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa262a36-1c5e-49cb-85ab-7f989705d29d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[57305d89-955e-4b25-861e-4e52fffabfb6]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:09 devstack sudo[91635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f Sep 18 00:36:09 devstack sudo[91635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:09 devstack sudo[91634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 Sep 18 00:36:09 devstack sudo[91634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:09 devstack sudo[91635]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f" returned: 0 in 0.395s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:09 devstack sudo[91634]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934" returned: 0 in 0.430s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:09 devstack sudo[91644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f Sep 18 00:36:09 devstack sudo[91644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:09 devstack sudo[91646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934 Sep 18 00:36:09 devstack sudo[91646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:09 devstack sudo[91644]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-da852a24-d96a-41d3-ad0c-17dc37d60f0f" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:09 devstack sudo[91646]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934" returned: 0 in 0.253s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-da852a24-d96a-41d3-ad0c-17dc37d60f0f" released by "delete_volume" :: held 0.709s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Lock "cinder-quobyte-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934" released by "delete_volume" :: held 0.741s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Created reservations ['62dbcbc8-75d3-4f6f-abce-dddad6bb7c2a', '46856e6a-29df-41a4-8339-acea621a86a2', '083e11d9-342f-4aa7-811d-c53b91912482', '4dd6c497-2062-4626-ba83-506e0784e987'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Created reservations ['4454bd42-e062-479c-9b52-af12bdc766a3', '820742ad-1cfa-4e9e-835a-0f141c089527', '4ceb4118-8340-4e6f-b21e-4e7a5602aad3', '6e1d486c-f262-4b84-a7d4-5e92a3ca586a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:10 devstack sudo[91651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:10 devstack sudo[91651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:10 devstack sudo[91653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:10 devstack sudo[91653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:10 devstack sudo[91653]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.353s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:10 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Deleted volume successfully. Sep 18 00:36:10 devstack sudo[91651]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.442s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:10 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Deleted volume successfully. Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-689f1a4a-83f4-40b2-b25a-17b802179ceb tempest-VolumesActionsTest-1784712139 None] Lock "cinder-4cfb6c47-ad51-46f9-a9a5-0b21f5a58934-delete_volume" released by "delete_volume" :: held 1.413s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-71d6f113-5f61-47d1-a4ed-f1a4ce57a800-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47ca1e3f-6e9b-42d9-b7ff-7bb87a79f493 tempest-VolumesGetTest-103664594 None] Lock "cinder-da852a24-d96a-41d3-ad0c-17dc37d60f0f-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Lock "cinder-71d6f113-5f61-47d1-a4ed-f1a4ce57a800-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-71d6f113-5f61-47d1-a4ed-f1a4ce57a800" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-71d6f113-5f61-47d1-a4ed-f1a4ce57a800" acquired by "delete_volume" :: waited 0.041s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e73ae1-2ec0-42c6-8469-40851489c56e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:10 devstack sudo[91659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 Sep 18 00:36:10 devstack sudo[91659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (9935dc38-b830-4038-a230-8fab6d9fb380) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:11 devstack sudo[91659]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73827bd-5526-4cc9-b49a-9ef1ce1453cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800" returned: 0 in 0.505s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f73827bd-5526-4cc9-b49a-9ef1ce1453cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-528189173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9f72ce-b867-4162-891f-bc6f23c49abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:11Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8cee9d-0d73-47ad-86c5-d9130c90039c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a8cee9d-0d73-47ad-86c5-d9130c90039c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:11 devstack sudo[91665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800 Sep 18 00:36:11 devstack sudo[91665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dad427-ffd8-4de5-94d2-05b734f0f397) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62dad427-ffd8-4de5-94d2-05b734f0f397) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9f72ce-b867-4162-891f-bc6f23c49abf', 'volume_name': 'volume-5a9f72ce-b867-4162-891f-bc6f23c49abf', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fbd40f-3bc3-40d2-8fb8-e346ef020456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88fbd40f-3bc3-40d2-8fb8-e346ef020456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c9bfb1-9f1c-4029-a4d2-1e74d9ab9640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:11 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Volume 5a9f72ce-b867-4162-891f-bc6f23c49abf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9f72ce-b867-4162-891f-bc6f23c49abf', 'volume_size': 1} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-528189173',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9f72ce-b867-4162-891f-bc6f23c49abf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5f32181387c54f8691fbfa90caa1533c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:11Z,use_quota=True,user_id='e5f1fb3bd5ce45bfa5d28289ca92cb43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Creating volume 5a9f72ce-b867-4162-891f-bc6f23c49abf {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:11 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:11 devstack sudo[91667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf 1073741824 Sep 18 00:36:11 devstack sudo[91667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:11 devstack sudo[91665]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-71d6f113-5f61-47d1-a4ed-f1a4ce57a800" returned: 0 in 0.383s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-71d6f113-5f61-47d1-a4ed-f1a4ce57a800" released by "delete_volume" :: held 0.978s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Created reservations ['c8fd1aab-e973-42b5-8ac6-5a3b96edf614', 'e93d62e6-6781-4dda-ba2a-1a968e4c241e', '18be6ffc-cf22-42e3-9ee3-53fe350b0e70', 'cd6f1a92-03ab-464c-b8ee-6e7d2bcb1ed9'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:11 devstack sudo[91674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:11 devstack sudo[91674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:12 devstack sudo[91667]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf 1073741824" returned: 0 in 0.843s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:12 devstack sudo[91674]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.341s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Deleted volume successfully. Sep 18 00:36:12 devstack sudo[91677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf Sep 18 00:36:12 devstack sudo[91677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-89e44d76-89cf-4935-8ef4-408f3c9d0649 tempest-VolumesGetTest-103664594 None] Lock "cinder-71d6f113-5f61-47d1-a4ed-f1a4ce57a800-delete_volume" released by "delete_volume" :: held 1.654s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:12 devstack sudo[91677]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf" returned: 0 in 0.302s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] <== create_volume: return (1210ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.213s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22c9bfb1-9f1c-4029-a4d2-1e74d9ab9640) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9f72ce-b867-4162-891f-bc6f23c49abf', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb89f5ec-4b77-40e3-9033-6b9a5e776fbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:12 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Volume volume-5a9f72ce-b867-4162-891f-bc6f23c49abf (5a9f72ce-b867-4162-891f-bc6f23c49abf): created successfully Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb89f5ec-4b77-40e3-9033-6b9a5e776fbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Flow 'volume_create_manager' (9935dc38-b830-4038-a230-8fab6d9fb380) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a9683150-4ff2-433b-852e-dc54b707dc3c tempest-VolumesActionsTest-1175847581 None] Created volume successfully. Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (0e555ff8-5d43-4acc-9320-5560ef57fc51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe3ab95-5c01-4f17-bccc-1f4c5839930a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5fe3ab95-5c01-4f17-bccc-1f4c5839930a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-626577356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a274f660-bce8-4971-b9c3-2c7fa41e9366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:13Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb1974e-f5e6-4e61-aea0-9770e2fa9111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4eb1974e-f5e6-4e61-aea0-9770e2fa9111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ecab6f-6299-4735-9009-32e82d861106) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27ecab6f-6299-4735-9009-32e82d861106) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a274f660-bce8-4971-b9c3-2c7fa41e9366', 'volume_name': 'volume-a274f660-bce8-4971-b9c3-2c7fa41e9366', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f387a803-83ac-49f7-9d85-f126448b89e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f387a803-83ac-49f7-9d85-f126448b89e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebb7746-d199-45a3-b90d-6b6ed8db56cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:13 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Volume a274f660-bce8-4971-b9c3-2c7fa41e9366: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a274f660-bce8-4971-b9c3-2c7fa41e9366', 'volume_size': 1} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-626577356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a274f660-bce8-4971-b9c3-2c7fa41e9366,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:13Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Creating volume a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:13 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:13 devstack sudo[91686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 1073741824 Sep 18 00:36:13 devstack sudo[91686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "cinder-5a9f72ce-b867-4162-891f-bc6f23c49abf-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-5a9f72ce-b867-4162-891f-bc6f23c49abf-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:14 devstack sudo[91686]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 1073741824" returned: 0 in 0.665s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "cinder-quobyte-5a9f72ce-b867-4162-891f-bc6f23c49abf" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-quobyte-5a9f72ce-b867-4162-891f-bc6f23c49abf" acquired by "delete_volume" :: waited 0.055s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:14 devstack sudo[91695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 Sep 18 00:36:14 devstack sudo[91695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a31c698-ce63-4f95-86df-8de2fc38ae5a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:14 devstack sudo[91697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf Sep 18 00:36:14 devstack sudo[91697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:14 devstack sudo[91695]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366" returned: 0 in 0.312s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] <== create_volume: return (1052ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ebb7746-d199-45a3-b90d-6b6ed8db56cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a274f660-bce8-4971-b9c3-2c7fa41e9366', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f46688-e6bd-4774-9dc4-cc5aa545cd81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Volume volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 (a274f660-bce8-4971-b9c3-2c7fa41e9366): created successfully Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (75f46688-e6bd-4774-9dc4-cc5aa545cd81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (0e555ff8-5d43-4acc-9320-5560ef57fc51) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e4cecfe7-8acb-41e6-96d1-9b8156a34582 tempest-VolumesGetTest-103664594 None] Created volume successfully. Sep 18 00:36:14 devstack sudo[91697]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf" returned: 0 in 0.483s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:14 devstack sudo[91704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf Sep 18 00:36:14 devstack sudo[91704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:15 devstack sudo[91704]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a9f72ce-b867-4162-891f-bc6f23c49abf" returned: 0 in 0.540s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-quobyte-5a9f72ce-b867-4162-891f-bc6f23c49abf" released by "delete_volume" :: held 1.120s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=98,cinder:UPDATE=122,cinder:INSERT=20,cinder:DELETE=10 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=83,cinder:UPDATE=116,cinder:INSERT=33,cinder:DELETE=11 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Created reservations ['c281d508-047d-403f-a6d0-f4de2a1b7cac', 'd98db348-8a77-4714-aa5a-361f8c779222', '162095c8-f51a-4b8f-bd8a-21c2057be436', 'b2e3eba4-45bd-4261-ac27-96cd2e4c9961'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:15 devstack sudo[91739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:15 devstack sudo[91739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:16 devstack sudo[91739]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.435s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Deleted volume successfully. Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53650f8b-5f7a-45f9-94b4-a67f0fd939f3 tempest-VolumesActionsTest-1175847581 None] Lock "cinder-5a9f72ce-b867-4162-891f-bc6f23c49abf-delete_volume" released by "delete_volume" :: held 2.070s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (a4bde2f6-9d8b-434f-8401-624156d5a1d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a895ebb1-d62c-47cf-b4a0-6bf0bef98de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a895ebb1-d62c-47cf-b4a0-6bf0bef98de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-202474085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f0e3498-5627-44ac-a6a0-746c9e57d15d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=a274f660-bce8-4971-b9c3-2c7fa41e9366,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:17Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19318c23-c72f-414a-b12c-0af51440cbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19318c23-c72f-414a-b12c-0af51440cbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f28af06-f15c-4fe8-8c92-ec2f9597011e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f28af06-f15c-4fe8-8c92-ec2f9597011e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '4f0e3498-5627-44ac-a6a0-746c9e57d15d', 'volume_name': 'volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d', 'volume_size': 1, 'source_volid': 'a274f660-bce8-4971-b9c3-2c7fa41e9366', 'source_volstatus': 'available'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2cce9-449c-486d-8764-1ab1654c8cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9a2cce9-449c-486d-8764-1ab1654c8cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a021081-06c5-441b-a900-973b23921076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Volume 4f0e3498-5627-44ac-a6a0-746c9e57d15d: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d', 'volume_size': 1, 'source_volid': 'a274f660-bce8-4971-b9c3-2c7fa41e9366', 'source_volstatus': 'available'} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:16 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Cloning volume a274f660-bce8-4971-b9c3-2c7fa41e9366 to volume 4f0e3498-5627-44ac-a6a0-746c9e57d15d Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Creating offline snapshot 2f48db47-8889-46e9-822b-1e3949a02105 of volume a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed40b021-91c7-460e-b0ba-4f4c248bdf58]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:17 devstack sudo[91757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 Sep 18 00:36:17 devstack sudo[91757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:17 devstack sudo[91757]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366" returned: 0 in 0.518s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:17 devstack sudo[91770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 1G Sep 18 00:36:17 devstack sudo[91770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:18 devstack sudo[91770]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 1G" returned: 0 in 0.637s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:18 devstack sudo[91777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 Sep 18 00:36:18 devstack sudo[91777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:18 devstack sudo[91777]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:18 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 is being set with open permissions: ugo+rw Sep 18 00:36:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:18 devstack sudo[91788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 Sep 18 00:36:18 devstack sudo[91788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b4f7ba2c-37f3-402a-84ea-242f8f545bcc req-41eae40b-7e73-4c25-b168-2fa8c1381850 tempest-TaggedAttachmentsTest-1343216865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:18 devstack sudo[91788]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105" returned: 0 in 0.420s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:18 devstack sudo[91796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.info Sep 18 00:36:18 devstack sudo[91796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:19 devstack sudo[91796]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.info" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:19 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.info is being set with open permissions: ugo+rw Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:19 devstack sudo[91799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.info Sep 18 00:36:19 devstack sudo[91799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:19 devstack sudo[91799]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.info" returned: 0 in 0.277s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-4f0e3498-5627-44ac-a6a0-746c9e57d15d" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-4f0e3498-5627-44ac-a6a0-746c9e57d15d" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] snapshot: 2f48db47-8889-46e9-822b-1e3949a02105, volume: 4f0e3498-5627-44ac-a6a0-746c9e57d15d, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[238b8fe1-d348-497b-bc77-cd60082ad1e0]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:19 devstack sudo[91803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 Sep 18 00:36:19 devstack sudo[91803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:20 devstack sudo[91803]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105" returned: 0 in 0.446s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a274f660-bce8-4971-b9c3-2c7fa41e9366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[228eeeb0-e3b5-4cac-9c5a-92a35d306d92]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:20 devstack sudo[91809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 Sep 18 00:36:20 devstack sudo[91809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:20 devstack sudo[91809]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:36:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:20 devstack sudo[91814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d Sep 18 00:36:20 devstack sudo[91814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:28 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=11,cinder:INSERT=4,cinder:UPDATE=10 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:36:28 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=7,cinder:SELECT=5,cinder:DELETE=1,cinder:INSERT=2 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:36:29 devstack sudo[91814]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d" returned: 0 in 8.551s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366, size 1024.00 MB, duration 8.55 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:36:29 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Converted 1024.00 MB image at 119.74 MB/s Sep 18 00:36:29 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d is being set with open permissions: ugo+rw Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:29 devstack sudo[91828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d Sep 18 00:36:29 devstack sudo[91828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:29 devstack sudo[91828]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-4f0e3498-5627-44ac-a6a0-746c9e57d15d" released by "_copy_volume_from_snapshot" :: held 9.775s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-2f48db47-8889-46e9-822b-1e3949a02105" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-2f48db47-8889-46e9-822b-1e3949a02105" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Deleting offline snapshot 2f48db47-8889-46e9-822b-1e3949a02105 of volume a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] snapshot_file for this snap is: volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[51cbb169-116a-456e-a6f3-ad2a2955cba5]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:29 devstack sudo[91831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 Sep 18 00:36:29 devstack sudo[91831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:29 devstack sudo[91831]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105" returned: 0 in 0.441s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a274f660-bce8-4971-b9c3-2c7fa41e9366(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[422bb323-a803-40a1-9551-a57ca34f98f1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:30 devstack sudo[91837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 Sep 18 00:36:30 devstack sudo[91837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:30 devstack sudo[91837]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366" returned: 0 in 0.595s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:30 devstack sudo[91843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 Sep 18 00:36:30 devstack sudo[91843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:30 devstack sudo[91843]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105" returned: 0 in 0.412s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:30 devstack sudo[91852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105 Sep 18 00:36:30 devstack sudo[91852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:31 devstack sudo[91852]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366.2f48db47-8889-46e9-822b-1e3949a02105" returned: 0 in 0.437s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-2f48db47-8889-46e9-822b-1e3949a02105" released by "_delete_snapshot" :: held 2.027s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.621s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b4f7ba2c-37f3-402a-84ea-242f8f545bcc req-41eae40b-7e73-4c25-b168-2fa8c1381850 tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.685s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a021081-06c5-441b-a900-973b23921076) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d', 'volume_size': 1, 'source_volid': 'a274f660-bce8-4971-b9c3-2c7fa41e9366', 'source_volstatus': 'available'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af00933d-a97b-4617-8dca-bb4ff871e407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b4f7ba2c-37f3-402a-84ea-242f8f545bcc req-41eae40b-7e73-4c25-b168-2fa8c1381850 tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.043s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:31 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Volume volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d (4f0e3498-5627-44ac-a6a0-746c9e57d15d): created successfully Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af00933d-a97b-4617-8dca-bb4ff871e407) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (a4bde2f6-9d8b-434f-8401-624156d5a1d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1fbab57b-9c1a-4a67-8578-2a9e9d3fa29f tempest-VolumesGetTest-103664594 None] Created volume successfully. Sep 18 00:36:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-b4f7ba2c-37f3-402a-84ea-242f8f545bcc req-41eae40b-7e73-4c25-b168-2fa8c1381850 tempest-TaggedAttachmentsTest-1343216865 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c8b32142-5cc3-4f97-96aa-d44e97b1d521', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:36:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b4f7ba2c-37f3-402a-84ea-242f8f545bcc req-41eae40b-7e73-4c25-b168-2fa8c1381850 tempest-TaggedAttachmentsTest-1343216865 None] attachment_update completed successfully. Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (013fce81-4263-4098-a9cc-4034cda20063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9702127e-5afc-48f4-8989-e2b7a8561aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9702127e-5afc-48f4-8989-e2b7a8561aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1632540979',display_name='tempest-VolumesGetTest-Volume-1398052897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d481b1d6-3dc1-4624-8e4a-273047bae71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:34Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a9f03-b959-4a30-bc44-9fc3c3e16ff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a28a9f03-b959-4a30-bc44-9fc3c3e16ff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74a39f0-375a-4906-8a55-34f4219015a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c74a39f0-375a-4906-8a55-34f4219015a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd481b1d6-3dc1-4624-8e4a-273047bae71d', 'volume_name': 'volume-d481b1d6-3dc1-4624-8e4a-273047bae71d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9383a9c-6a06-4167-ae6d-484ec225b6a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9383a9c-6a06-4167-ae6d-484ec225b6a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a814c3-0cff-4c06-ba84-b6770a373d2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Volume d481b1d6-3dc1-4624-8e4a-273047bae71d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d481b1d6-3dc1-4624-8e4a-273047bae71d', 'volume_size': 1} Sep 18 00:36:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:33Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1632540979',display_name='tempest-VolumesGetTest-Volume-1398052897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d481b1d6-3dc1-4624-8e4a-273047bae71d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:34Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Creating volume d481b1d6-3dc1-4624-8e4a-273047bae71d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:34 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:34 devstack sudo[92291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d 1073741824 Sep 18 00:36:34 devstack sudo[92291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:34 devstack sudo[92291]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d 1073741824" returned: 0 in 0.685s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:34 devstack sudo[92305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d Sep 18 00:36:34 devstack sudo[92305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:35 devstack sudo[92305]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d" returned: 0 in 0.277s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] <== create_volume: return (1031ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.033s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55a814c3-0cff-4c06-ba84-b6770a373d2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d481b1d6-3dc1-4624-8e4a-273047bae71d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b566faf9-45f3-4964-8faf-7097b9f00b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Volume volume-d481b1d6-3dc1-4624-8e4a-273047bae71d (d481b1d6-3dc1-4624-8e4a-273047bae71d): created successfully Sep 18 00:36:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b566faf9-45f3-4964-8faf-7097b9f00b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (013fce81-4263-4098-a9cc-4034cda20063) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-083af8ab-f1a3-4fc8-8c41-ca185bc250ad tempest-VolumesGetTest-103664594 None] Created volume successfully. Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-d481b1d6-3dc1-4624-8e4a-273047bae71d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Lock "cinder-d481b1d6-3dc1-4624-8e4a-273047bae71d-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-d481b1d6-3dc1-4624-8e4a-273047bae71d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-d481b1d6-3dc1-4624-8e4a-273047bae71d" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d0ea06b-fb19-452c-813f-59e645d77705]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:36 devstack sudo[92328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d Sep 18 00:36:36 devstack sudo[92328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-c3676fd4-bb36-4766-9703-b86deae08edf req-cc2af46e-d916-4900-8314-b760b855e3cd tempest-TaggedAttachmentsTest-1343216865 None] Terminate volume connection completed successfully. Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-c3676fd4-bb36-4766-9703-b86deae08edf req-cc2af46e-d916-4900-8314-b760b855e3cd tempest-TaggedAttachmentsTest-1343216865 None] Deleting attachment c8b32142-5cc3-4f97-96aa-d44e97b1d521. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:36:36 devstack sudo[92328]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d" returned: 0 in 0.633s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:36 devstack sudo[92360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d Sep 18 00:36:36 devstack sudo[92360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:37 devstack sudo[92360]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d481b1d6-3dc1-4624-8e4a-273047bae71d" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-d481b1d6-3dc1-4624-8e4a-273047bae71d" released by "delete_volume" :: held 0.999s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Created reservations ['ca99dc7e-b315-42eb-be49-35c61affbc29', '99e49c1b-5bf6-45b9-b749-4f25d9ac2913', '8ba5698a-28a0-4822-90a9-71e9ef6371af', '391aba4d-22c4-444a-a087-5853351199a2'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:37 devstack sudo[92366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:37 devstack sudo[92366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:38 devstack sudo[92366]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.576s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:38 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Deleted volume successfully. Sep 18 00:36:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-81edd8a5-4aab-4dd4-8a2a-fea1aba60b20 tempest-VolumesGetTest-103664594 None] Lock "cinder-d481b1d6-3dc1-4624-8e4a-273047bae71d-delete_volume" released by "delete_volume" :: held 1.956s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-4f0e3498-5627-44ac-a6a0-746c9e57d15d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Lock "cinder-4f0e3498-5627-44ac-a6a0-746c9e57d15d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-4f0e3498-5627-44ac-a6a0-746c9e57d15d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-4f0e3498-5627-44ac-a6a0-746c9e57d15d" acquired by "delete_volume" :: waited 0.044s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d01dcd2c-c2b0-4f57-832a-a0da2bbc08b3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:39 devstack sudo[92398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d Sep 18 00:36:39 devstack sudo[92398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:39 devstack sudo[92398]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d" returned: 0 in 0.827s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:39 devstack sudo[92456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d Sep 18 00:36:39 devstack sudo[92456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:40 devstack sudo[92456]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f0e3498-5627-44ac-a6a0-746c9e57d15d" returned: 0 in 0.637s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-4f0e3498-5627-44ac-a6a0-746c9e57d15d" released by "delete_volume" :: held 1.577s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Created reservations ['6db60248-9843-4e9a-9f09-2bf9e5fcdae6', 'a2a640c9-1dc5-4a37-8b4d-266d47f567db', '25f77eb4-2c20-49d2-88db-acd850fe265c', '6de29e80-b7f0-4be7-b92f-d6ee4404db78'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:40 devstack sudo[92468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:40 devstack sudo[92468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-a274f660-bce8-4971-b9c3-2c7fa41e9366-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:41 devstack sudo[92468]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.678s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:41 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Lock "cinder-a274f660-bce8-4971-b9c3-2c7fa41e9366-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Deleted volume successfully. Sep 18 00:36:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6a464134-ec00-4fd9-8cc5-b724e6bc57ed tempest-VolumesGetTest-103664594 None] Lock "cinder-4f0e3498-5627-44ac-a6a0-746c9e57d15d-delete_volume" released by "delete_volume" :: held 2.914s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-a274f660-bce8-4971-b9c3-2c7fa41e9366" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-a274f660-bce8-4971-b9c3-2c7fa41e9366" acquired by "delete_volume" :: waited 0.091s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:42 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[abcc6f5d-49de-4ab6-8aa5-64d799e8188d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:42 devstack sudo[92487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 Sep 18 00:36:42 devstack sudo[92487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:43 devstack sudo[92487]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366" returned: 0 in 1.056s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:43 devstack sudo[92518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366 Sep 18 00:36:43 devstack sudo[92518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:43 devstack sudo[92518]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a274f660-bce8-4971-b9c3-2c7fa41e9366" returned: 0 in 0.563s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-a274f660-bce8-4971-b9c3-2c7fa41e9366" released by "delete_volume" :: held 1.888s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Created reservations ['6c0abeb8-ea03-4a54-ae54-c8cfa5bd3be7', '93bfda8f-dff9-4960-ac95-70430ba7ff33', '02a10b71-c3af-4fa4-a412-b7d4ca3d86b6', '5576862b-fde4-4608-9d1c-fd4b125246a0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:44 devstack sudo[92534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:44 devstack sudo[92534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:44 devstack sudo[92534]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.337s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Deleted volume successfully. Sep 18 00:36:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-91857de4-3ada-4501-8567-bcb0d5e97fe4 tempest-VolumesGetTest-103664594 None] Lock "cinder-a274f660-bce8-4971-b9c3-2c7fa41e9366-delete_volume" released by "delete_volume" :: held 3.110s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (bedeab0d-5b31-4b4d-b68c-4a899a8468a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d2903c-56d8-4d75-becd-bf0643d0af95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (03d2903c-56d8-4d75-becd-bf0643d0af95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-73083318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e288f96c-3913-4785-a7a4-eb9567817aea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:47Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3c7988-50d0-456f-aad8-7c15d816ddce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a3c7988-50d0-456f-aad8-7c15d816ddce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08b64a5-9b3e-409f-9a50-a85fcd073b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:47 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:36:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d08b64a5-9b3e-409f-9a50-a85fcd073b86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'e288f96c-3913-4785-a7a4-eb9567817aea', 'volume_name': 'volume-e288f96c-3913-4785-a7a4-eb9567817aea', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10af2ae8-b1cc-4c66-a950-a907409e483e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (10af2ae8-b1cc-4c66-a950-a907409e483e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f85d31-2296-4664-9101-454aaff665d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:49 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Volume e288f96c-3913-4785-a7a4-eb9567817aea: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-e288f96c-3913-4785-a7a4-eb9567817aea', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 00:36:49 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Trying to clone e288f96c-3913-4785-a7a4-eb9567817aea from image 08c75831-54cd-415b-93ab-76883c9da538 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:36:50 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:36:50 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Image download 20.69 MB at 20.69 MB/s Sep 18 00:36:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd6737c7-cfea-467d-80b1-e17fa9443c63]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:50 devstack sudo[92592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD Sep 18 00:36:50 devstack sudo[92592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:50 devstack sudo[92592]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD" returned: 0 in 0.728s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:50 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 is fetched for user 248fb5fd7e3c4480ac44a3207e45f71b. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[34cdb054-431c-41ca-b773-a0824b3951fd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:51 devstack sudo[92616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD Sep 18 00:36:51 devstack sudo[92616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:51 devstack sudo[92616]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD" returned: 0 in 0.683s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-73083318',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e288f96c-3913-4785-a7a4-eb9567817aea,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:47Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Creating volume e288f96c-3913-4785-a7a4-eb9567817aea {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:51 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:51 devstack sudo[92627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea 1073741824 Sep 18 00:36:51 devstack sudo[92627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:52 devstack sudo[92627]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea 1073741824" returned: 0 in 0.882s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:52 devstack sudo[92634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea Sep 18 00:36:52 devstack sudo[92634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:53 devstack sudo[92634]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea" returned: 0 in 0.594s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] <== create_volume: return (1576ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.582s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:53 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Attempting download of 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume e288f96c-3913-4785-a7a4-eb9567817aea. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:36:53 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e96f96f6-a357-4fd8-8eee-2750cce39191]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_9_hhartv {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:54 devstack sudo[92638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_9_hhartv Sep 18 00:36:54 devstack sudo[92638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:54 devstack sudo[92638]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_9_hhartv" returned: 0 in 1.005s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_9_hhartv {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:54 devstack sudo[92676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_9_hhartv Sep 18 00:36:54 devstack sudo[92676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:55 devstack sudo[92676]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_9_hhartv" returned: 1 in 0.794s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_9_hhartv' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:36:55 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[45e83097-29c6-406a-9f82-a787581628b9]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:55 devstack sudo[92695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD Sep 18 00:36:55 devstack sudo[92695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:56 devstack sudo[92695]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD" returned: 0 in 0.623s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] 08c75831-54cd-415b-93ab-76883c9da538 was qcow2, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:56 devstack sudo[92700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea Sep 18 00:36:56 devstack sudo[92700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Flow 'volume_create_manager' (633e8c72-e8e1-4b42-a615-e20f37419496) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ae802f-f384-4e1f-b0c5-41f563300353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (64ae802f-f384-4e1f-b0c5-41f563300353) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-859788287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65a7de5-b9d2-4018-8865-b58469aefa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98b191b14d2446d979b411216702bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:56Z,use_quota=True,user_id='3e2816af00034b0e8c733a77ba823dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a08fda-152a-4542-b6b1-9e6f45482270) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0a08fda-152a-4542-b6b1-9e6f45482270) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d976cf9-33a5-4118-af80-e950cf827439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d976cf9-33a5-4118-af80-e950cf827439) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e65a7de5-b9d2-4018-8865-b58469aefa0a', 'volume_name': 'volume-e65a7de5-b9d2-4018-8865-b58469aefa0a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f8204d-86d4-4322-8155-f2a23b58a17f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f6f8204d-86d4-4322-8155-f2a23b58a17f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd36718-f583-42fb-a11c-96c76bd4164f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:56 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Volume e65a7de5-b9d2-4018-8865-b58469aefa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e65a7de5-b9d2-4018-8865-b58469aefa0a', 'volume_size': 1} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-859788287',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e65a7de5-b9d2-4018-8865-b58469aefa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e98b191b14d2446d979b411216702bb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:56Z,use_quota=True,user_id='3e2816af00034b0e8c733a77ba823dc4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Creating volume e65a7de5-b9d2-4018-8865-b58469aefa0a {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:36:56 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:56 devstack sudo[92707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a 1073741824 Sep 18 00:36:56 devstack sudo[92707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Acquiring lock "cinder-c7cf0a93-4ac5-4424-9efb-3fb7362f0389-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Lock "cinder-c7cf0a93-4ac5-4424-9efb-3fb7362f0389-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Acquiring lock "cinder-quobyte-c7cf0a93-4ac5-4424-9efb-3fb7362f0389" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Lock "cinder-quobyte-c7cf0a93-4ac5-4424-9efb-3fb7362f0389" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9339c61d-3554-4d04-ac94-2a8147daa594]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:57 devstack sudo[92710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 Sep 18 00:36:57 devstack sudo[92710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:57 devstack sudo[92707]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a 1073741824" returned: 0 in 0.803s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:57 devstack sudo[92710]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389" returned: 0 in 0.637s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:57 devstack sudo[92720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a Sep 18 00:36:57 devstack sudo[92720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:57 devstack sudo[92721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389 Sep 18 00:36:57 devstack sudo[92721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:58 devstack sudo[92720]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a" returned: 0 in 0.349s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] <== create_volume: return (1216ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.222s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fdd36718-f583-42fb-a11c-96c76bd4164f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e65a7de5-b9d2-4018-8865-b58469aefa0a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4ea105-4ce5-493d-9d06-c3d4b8b5bb27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:58 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Volume volume-e65a7de5-b9d2-4018-8865-b58469aefa0a (e65a7de5-b9d2-4018-8865-b58469aefa0a): created successfully Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c4ea105-4ce5-493d-9d06-c3d4b8b5bb27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Flow 'volume_create_manager' (633e8c72-e8e1-4b42-a615-e20f37419496) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d27913f1-31ec-4e44-b899-bb4cd92e6ed7 tempest-ServerRescueNegativeTestJSON-1288531191 None] Created volume successfully. Sep 18 00:36:58 devstack sudo[92721]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c7cf0a93-4ac5-4424-9efb-3fb7362f0389" returned: 0 in 0.558s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Lock "cinder-quobyte-c7cf0a93-4ac5-4424-9efb-3fb7362f0389" released by "delete_volume" :: held 1.270s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Created reservations ['6f155041-990c-4f12-89b0-a656b80c6abf', 'f016af50-aa14-4f47-a72a-6ab5ce173ba8', 'eb8bfa06-cef4-4874-b3ce-a5b20a6beccf', '3adf9d11-88d0-41c5-8dc8-a9c92e7e6082'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:58 devstack sudo[92726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:36:58 devstack sudo[92726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Flow 'volume_create_manager' (36b37b68-b892-405a-8630-ddfd8e02dcf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e6ed8e-8cd0-462b-b734-202ce738b1b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34e6ed8e-8cd0-462b-b734-202ce738b1b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1288689345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d9abae-2108-495c-ab34-beb79d43937c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff3544ac67848de9bc5b4b7bf2710a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:59Z,use_quota=True,user_id='0ad697f5526b47689f294546e6139d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04b60b1-516c-4c4b-9851-d9453b814edb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b04b60b1-516c-4c4b-9851-d9453b814edb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16446ff-2c66-45cc-944a-1838d06108ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:58 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:36:59 devstack sudo[92726]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.582s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:36:59 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Deleted volume successfully. Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-72de426f-fa82-4eab-8523-8e25d2db879a tempest-TaggedAttachmentsTest-1343216865 None] Lock "cinder-c7cf0a93-4ac5-4424-9efb-3fb7362f0389-delete_volume" released by "delete_volume" :: held 2.245s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:36:59 devstack sudo[92700]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea" returned: 0 in 3.020s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_9s4nk_g0devstack@QuobyteHD, size 112.00 MB, duration 3.02 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:36:59 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Converted 112.00 MB image at 37.07 MB/s Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:36:59 devstack sudo[92730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea 1G Sep 18 00:36:59 devstack sudo[92730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f16446ff-2c66-45cc-944a-1838d06108ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '59d9abae-2108-495c-ab34-beb79d43937c', 'volume_name': 'volume-59d9abae-2108-495c-ab34-beb79d43937c', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1113687-ecb5-4a6c-8b48-9ce016f865ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1113687-ecb5-4a6c-8b48-9ce016f865ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1b99be-6b6d-4801-91a9-4f324f2ee4f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:36:59 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Volume 59d9abae-2108-495c-ab34-beb79d43937c: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-59d9abae-2108-495c-ab34-beb79d43937c', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Trying to clone 59d9abae-2108-495c-ab34-beb79d43937c from image 08c75831-54cd-415b-93ab-76883c9da538 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:36:59 devstack sudo[92730]: pam_unix(sudo:session): session closed for user root Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea 1G" returned: 0 in 0.640s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Downloaded image 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume e288f96c-3913-4785-a7a4-eb9567817aea successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 for user 248fb5fd7e3c4480ac44a3207e45f71b is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Marking volume e288f96c-3913-4785-a7a4-eb9567817aea as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Copying metadata from image 08c75831-54cd-415b-93ab-76883c9da538 to e288f96c-3913-4785-a7a4-eb9567817aea. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:36:59 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Creating volume glance metadata for volume e288f96c-3913-4785-a7a4-eb9567817aea backed by image 08c75831-54cd-415b-93ab-76883c9da538 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:37:00 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Image download 20.69 MB at 20.69 MB/s Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5f85d31-2296-4664-9101-454aaff665d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e288f96c-3913-4785-a7a4-eb9567817aea', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c232c7a8-db18-4ddd-be54-59097f4b0b56) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bbb67c3-15c0-48c7-a090-06688d5539cc]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:00 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Volume volume-e288f96c-3913-4785-a7a4-eb9567817aea (e288f96c-3913-4785-a7a4-eb9567817aea): created successfully Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c232c7a8-db18-4ddd-be54-59097f4b0b56) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (bedeab0d-5b31-4b4d-b68c-4a899a8468a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-24111ff8-e7fb-48ee-8c10-c50a076ca53f tempest-VolumesGetTest-103664594 None] Created volume successfully. Sep 18 00:37:00 devstack sudo[92738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD Sep 18 00:37:00 devstack sudo[92738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:00 devstack sudo[92738]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD" returned: 0 in 0.703s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:00 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 is fetched for user 0ad697f5526b47689f294546e6139d60. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df98082-fe0f-44f6-b6ef-c889086a0693]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:01 devstack sudo[92755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD Sep 18 00:37:01 devstack sudo[92755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:01 devstack sudo[92755]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD" returned: 0 in 0.769s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:36:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1288689345',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d9abae-2108-495c-ab34-beb79d43937c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ff3544ac67848de9bc5b4b7bf2710a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:36:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:36:59Z,use_quota=True,user_id='0ad697f5526b47689f294546e6139d60',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Creating volume 59d9abae-2108-495c-ab34-beb79d43937c {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:37:01 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:37:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:01 devstack sudo[92781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c 1073741824 Sep 18 00:37:01 devstack sudo[92781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (b00ab1d7-e73b-44ca-993e-6fa356283544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23671c96-df0e-48e5-9828-04737ae84ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (23671c96-df0e-48e5-9828-04737ae84ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1053135482',display_name='tempest-VolumesGetTest-Volume-843463414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc56c5f-71f2-458e-85c1-f8fe43cae180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:02Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e759d8-8427-4fc9-87a9-f3bd69c40eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (12e759d8-8427-4fc9-87a9-f3bd69c40eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c9cbb5-4d8d-4351-a7ea-88100675faa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (91c9cbb5-4d8d-4351-a7ea-88100675faa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7cc56c5f-71f2-458e-85c1-f8fe43cae180', 'volume_name': 'volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d547f974-6cb4-495b-a375-3363107be565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d547f974-6cb4-495b-a375-3363107be565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375cdc2-f606-4d10-ad9a-9d79381beaa2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:02 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Volume 7cc56c5f-71f2-458e-85c1-f8fe43cae180: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180', 'volume_size': 1} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:02 devstack sudo[92781]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c 1073741824" returned: 0 in 0.803s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:02 devstack sudo[92791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c Sep 18 00:37:02 devstack sudo[92791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:03 devstack sudo[92791]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c" returned: 0 in 0.604s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] <== create_volume: return (1461ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.466s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.980s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:02Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1053135482',display_name='tempest-VolumesGetTest-Volume-843463414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7cc56c5f-71f2-458e-85c1-f8fe43cae180,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='783fcc741f8c4ff3b9e47c1d6bd782f7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:02Z,use_quota=True,user_id='248fb5fd7e3c4480ac44a3207e45f71b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Creating volume 7cc56c5f-71f2-458e-85c1-f8fe43cae180 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:37:03 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:03 devstack sudo[92795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 1073741824 Sep 18 00:37:03 devstack sudo[92795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Attempting download of 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume 59d9abae-2108-495c-ab34-beb79d43937c. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bce14089-53eb-4b97-8ebf-5d41c6b86182]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_smjm0_r0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:03 devstack sudo[92797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_smjm0_r0 Sep 18 00:37:03 devstack sudo[92797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:04 devstack sudo[92797]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_smjm0_r0" returned: 0 in 0.580s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_smjm0_r0 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:04 devstack sudo[92795]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 1073741824" returned: 0 in 0.895s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:04 devstack sudo[92805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_smjm0_r0 Sep 18 00:37:04 devstack sudo[92805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:04 devstack sudo[92807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:37:04 devstack sudo[92807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:04 devstack sudo[92808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 Sep 18 00:37:04 devstack sudo[92808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:04 devstack sudo[92805]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_smjm0_r0" returned: 1 in 0.548s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_smjm0_r0' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[57c1f197-ecd5-41fe-a149-d46753ce1cc3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:04 devstack sudo[92807]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.467s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:37:04 devstack sudo[92813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD Sep 18 00:37:04 devstack sudo[92813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:04 devstack sudo[92808]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180" returned: 0 in 0.587s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] <== create_volume: return (1589ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:37:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.595s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7375cdc2-f606-4d10-ad9a-9d79381beaa2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3971646c-8a3c-4f4a-915d-5225fdfd6259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:05 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Volume volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 (7cc56c5f-71f2-458e-85c1-f8fe43cae180): created successfully Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3971646c-8a3c-4f4a-915d-5225fdfd6259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Flow 'volume_create_manager' (b00ab1d7-e73b-44ca-993e-6fa356283544) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:05 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e4f10a3b-0e1b-4236-8440-6e16ec49c3fc tempest-VolumesGetTest-103664594 None] Created volume successfully. Sep 18 00:37:05 devstack sudo[92813]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD" returned: 0 in 0.958s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] 08c75831-54cd-415b-93ab-76883c9da538 was qcow2, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:05 devstack sudo[92821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c Sep 18 00:37:05 devstack sudo[92821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-7cc56c5f-71f2-458e-85c1-f8fe43cae180-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:06 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Lock "cinder-7cc56c5f-71f2-458e-85c1-f8fe43cae180-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:06 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-7cc56c5f-71f2-458e-85c1-f8fe43cae180" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:06 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-7cc56c5f-71f2-458e-85c1-f8fe43cae180" acquired by "delete_volume" :: waited 0.038s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:06 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5d0a8ce-91ab-4e1f-81d2-992b7e045494]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:06 devstack sudo[92826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 Sep 18 00:37:06 devstack sudo[92826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:07 devstack sudo[92826]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180" returned: 0 in 0.896s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:07 devstack sudo[92877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180 Sep 18 00:37:07 devstack sudo[92877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:07 devstack sudo[92877]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7cc56c5f-71f2-458e-85c1-f8fe43cae180" returned: 0 in 0.503s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-7cc56c5f-71f2-458e-85c1-f8fe43cae180" released by "delete_volume" :: held 1.492s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Created reservations ['e840e880-faa3-4529-ba50-ac987ed973bd', '75700480-b443-46f4-bc3f-44d10a1fe179', '3ecf4e61-e9f2-43ee-b6a3-ab8da526a1eb', '95bc1d29-79c7-4a3a-a6c9-34918025a44a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:07 devstack sudo[92895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:37:07 devstack sudo[92895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:08 devstack sudo[92895]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:37:08 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Deleted volume successfully. Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8627243c-43b4-495f-beb2-1f0120c966aa tempest-VolumesGetTest-103664594 None] Lock "cinder-7cc56c5f-71f2-458e-85c1-f8fe43cae180-delete_volume" released by "delete_volume" :: held 2.186s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-e288f96c-3913-4785-a7a4-eb9567817aea-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Lock "cinder-e288f96c-3913-4785-a7a4-eb9567817aea-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Acquiring lock "cinder-quobyte-e288f96c-3913-4785-a7a4-eb9567817aea" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-e288f96c-3913-4785-a7a4-eb9567817aea" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f2c7d9c-6709-4ab8-a205-fbfa77ba60b3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:08 devstack sudo[92899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea Sep 18 00:37:08 devstack sudo[92899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:09 devstack sudo[92821]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c" returned: 0 in 3.444s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_5v60kr3ddevstack@QuobyteHD, size 112.00 MB, duration 3.45 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:37:09 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Converted 112.00 MB image at 32.51 MB/s Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:09 devstack sudo[92901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c 1G Sep 18 00:37:09 devstack sudo[92901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Acquiring lock "cinder-e65a7de5-b9d2-4018-8865-b58469aefa0a-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "cinder-e65a7de5-b9d2-4018-8865-b58469aefa0a-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:09 devstack sudo[92899]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Acquiring lock "cinder-quobyte-e65a7de5-b9d2-4018-8865-b58469aefa0a" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea" returned: 0 in 0.695s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "cinder-quobyte-e65a7de5-b9d2-4018-8865-b58469aefa0a" acquired by "delete_volume" :: waited 0.046s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:09 devstack sudo[92906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea Sep 18 00:37:09 devstack sudo[92906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3472bbc9-bebf-4f4c-b8a7-986e7ba9d98c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:09 devstack sudo[92910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a Sep 18 00:37:09 devstack sudo[92910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:09 devstack sudo[92901]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c 1G" returned: 0 in 0.619s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Downloaded image 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume 59d9abae-2108-495c-ab34-beb79d43937c successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 for user 0ad697f5526b47689f294546e6139d60 is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Marking volume 59d9abae-2108-495c-ab34-beb79d43937c as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:37:09 devstack sudo[92906]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e288f96c-3913-4785-a7a4-eb9567817aea" returned: 0 in 0.373s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Copying metadata from image 08c75831-54cd-415b-93ab-76883c9da538 to 59d9abae-2108-495c-ab34-beb79d43937c. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Creating volume glance metadata for volume 59d9abae-2108-495c-ab34-beb79d43937c backed by image 08c75831-54cd-415b-93ab-76883c9da538 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Lock "cinder-quobyte-e288f96c-3913-4785-a7a4-eb9567817aea" released by "delete_volume" :: held 1.169s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:09 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Created reservations ['193b1670-9fd6-4778-acf5-1a818fa2c650', '458e8838-00d5-4fab-98db-1696f45ea76d', '5c293f43-72de-4269-bf00-030fbb7ad5ae', '625e179d-68ee-4b8c-9ddb-7592f5d58189'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4f1b99be-6b6d-4801-91a9-4f324f2ee4f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d9abae-2108-495c-ab34-beb79d43937c', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47d145a-edd6-40a7-8585-3218a7b2d422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:10 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Volume volume-59d9abae-2108-495c-ab34-beb79d43937c (59d9abae-2108-495c-ab34-beb79d43937c): created successfully Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a47d145a-edd6-40a7-8585-3218a7b2d422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Flow 'volume_create_manager' (36b37b68-b892-405a-8630-ddfd8e02dcf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:10 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-46855705-bee5-4cb4-bf0d-e2fb170ab18c tempest-VolumesImageMetadata-644151245 None] Created volume successfully. Sep 18 00:37:10 devstack sudo[92910]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a" returned: 0 in 0.595s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:10 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a Sep 18 00:37:10 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:10 devstack sudo[92921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:37:10 devstack sudo[92921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:10 devstack sudo[92921]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:37:10 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Deleted volume successfully. Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-de0286d7-0fcf-4621-9e86-09bdf24a1d2f tempest-VolumesGetTest-103664594 None] Lock "cinder-e288f96c-3913-4785-a7a4-eb9567817aea-delete_volume" released by "delete_volume" :: held 1.897s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:10 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e65a7de5-b9d2-4018-8865-b58469aefa0a" returned: 0 in 0.401s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "cinder-quobyte-e65a7de5-b9d2-4018-8865-b58469aefa0a" released by "delete_volume" :: held 1.059s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Created reservations ['bcfdb726-d7d4-40ce-8fbe-b8adba5437b4', '74783216-ed7f-4f82-b140-34df1d4691ee', 'aea1cada-056d-4d5a-8c03-2bce2dbc1747', 'c45236d3-f994-41c7-834f-f87a7cd0f3ca'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:10 devstack sudo[92926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:37:10 devstack sudo[92926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:10 devstack sudo[92926]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.320s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:10 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:37:10 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Deleted volume successfully. Sep 18 00:37:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7309a0c8-eaef-4cce-ad89-f6b198cd2399 tempest-ServerRescueNegativeTestJSON-1288531191 None] Lock "cinder-e65a7de5-b9d2-4018-8865-b58469aefa0a-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Acquiring lock "cinder-59d9abae-2108-495c-ab34-beb79d43937c-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Lock "cinder-59d9abae-2108-495c-ab34-beb79d43937c-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Acquiring lock "cinder-quobyte-59d9abae-2108-495c-ab34-beb79d43937c" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Lock "cinder-quobyte-59d9abae-2108-495c-ab34-beb79d43937c" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2e36fa-3eb2-48c1-82d2-dc0295c4e739]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:12 devstack sudo[92931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c Sep 18 00:37:12 devstack sudo[92931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:12 devstack sudo[92931]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c" returned: 0 in 0.763s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:13 devstack sudo[92964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c Sep 18 00:37:13 devstack sudo[92964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:13 devstack sudo[92964]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d9abae-2108-495c-ab34-beb79d43937c" returned: 0 in 0.437s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Lock "cinder-quobyte-59d9abae-2108-495c-ab34-beb79d43937c" released by "delete_volume" :: held 1.269s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Created reservations ['843d6040-073a-4913-b8e9-4a67366431f7', 'ec0c3e0c-685b-44f1-948b-940d8c772bb8', '9a0d9868-74ec-4d9a-b95e-c2b2f55f6865', 'e91c6888-20cf-4b3b-95fc-fdf4023776f3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:13 devstack sudo[92971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:37:13 devstack sudo[92971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:13 devstack sudo[92971]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.311s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:14 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:37:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Deleted volume successfully. Sep 18 00:37:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fe7a7e9d-6834-4339-b48d-577edf230ba4 tempest-VolumesImageMetadata-644151245 None] Lock "cinder-59d9abae-2108-495c-ab34-beb79d43937c-delete_volume" released by "delete_volume" :: held 1.957s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Flow 'volume_create_manager' (54690ce4-b205-4c8c-9a05-a7a754851209) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc21532a-60a8-4d74-8095-19feb69dd9bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dc21532a-60a8-4d74-8095-19feb69dd9bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1803920378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488d456c-c408-4005-9bcb-7a487ee88d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6201ca72fa0b425bb9c1292b5384db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:21Z,use_quota=True,user_id='a3845bffed734ed9a1c1868b7384afd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b82b23-fbb2-4a8c-8543-738a485d68ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68b82b23-fbb2-4a8c-8543-738a485d68ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da96c8b9-1d7c-4540-81ed-8d57c39d7d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da96c8b9-1d7c-4540-81ed-8d57c39d7d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '488d456c-c408-4005-9bcb-7a487ee88d6e', 'volume_name': 'volume-488d456c-c408-4005-9bcb-7a487ee88d6e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f2a286-f069-42c5-8ca4-8d1ea129f01c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97f2a286-f069-42c5-8ca4-8d1ea129f01c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d54bf41-5910-4bb9-87c1-7f4c7242b0b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Volume 488d456c-c408-4005-9bcb-7a487ee88d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-488d456c-c408-4005-9bcb-7a487ee88d6e', 'volume_size': 1} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1803920378',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=488d456c-c408-4005-9bcb-7a487ee88d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6201ca72fa0b425bb9c1292b5384db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:21Z,use_quota=True,user_id='a3845bffed734ed9a1c1868b7384afd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Creating volume 488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:37:20 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:37:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:20 devstack sudo[93002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e 1073741824 Sep 18 00:37:20 devstack sudo[93002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:21 devstack sudo[93002]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e 1073741824" returned: 0 in 0.516s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:21 devstack sudo[93008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e Sep 18 00:37:21 devstack sudo[93008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:21 devstack sudo[93008]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e" returned: 0 in 0.338s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d54bf41-5910-4bb9-87c1-7f4c7242b0b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-488d456c-c408-4005-9bcb-7a487ee88d6e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082fe326-ea5c-4b94-9247-61755ec3fe8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Volume volume-488d456c-c408-4005-9bcb-7a487ee88d6e (488d456c-c408-4005-9bcb-7a487ee88d6e): created successfully Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (082fe326-ea5c-4b94-9247-61755ec3fe8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Flow 'volume_create_manager' (54690ce4-b205-4c8c-9a05-a7a754851209) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cbdee53b-4112-4741-b314-1a7e193cbafb tempest-VolumesDeleteCascade-1613233050 None] Created volume successfully. Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Creating offline snapshot cc978ea8-3f8c-4837-aef8-febfde6f6613 of volume 488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd551d4-abde-4dd6-a41f-b441b13982b7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:23 devstack sudo[93012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e Sep 18 00:37:23 devstack sudo[93012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:23 devstack sudo[93012]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e" returned: 0 in 0.396s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:23 devstack sudo[93018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 1G Sep 18 00:37:23 devstack sudo[93018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:23 devstack sudo[93018]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 1G" returned: 0 in 0.461s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488d456c-c408-4005-9bcb-7a487ee88d6e -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:23 devstack sudo[93025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488d456c-c408-4005-9bcb-7a487ee88d6e -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 Sep 18 00:37:23 devstack sudo[93025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:24 devstack sudo[93025]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488d456c-c408-4005-9bcb-7a487ee88d6e -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613" returned: 0 in 0.383s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:24 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 is being set with open permissions: ugo+rw Sep 18 00:37:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:24 devstack sudo[93030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 Sep 18 00:37:24 devstack sudo[93030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:24 devstack sudo[93030]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:24 devstack sudo[93033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.info Sep 18 00:37:24 devstack sudo[93033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:24 devstack sudo[93033]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.info" returned: 0 in 0.298s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:24 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.info is being set with open permissions: ugo+rw Sep 18 00:37:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:25 devstack sudo[93036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.info Sep 18 00:37:25 devstack sudo[93036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:25 devstack sudo[93036]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.info" returned: 0 in 0.308s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.306s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-67cba042-22e4-474f-a504-a71a75d57c53 tempest-VolumesDeleteCascade-1613233050 None] Create snapshot completed successfully Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Creating offline snapshot 3f9c46d5-60ef-424a-86e2-545628f2ffd8 of volume 488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c819c13-539c-47b3-9374-fb32af9ea30f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:26 devstack sudo[93039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 Sep 18 00:37:26 devstack sudo[93039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:26 devstack sudo[93039]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613" returned: 0 in 0.494s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488d456c-c408-4005-9bcb-7a487ee88d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:37:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:27 devstack sudo[93044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 1G Sep 18 00:37:27 devstack sudo[93044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:27 devstack sudo[93044]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 1G" returned: 0 in 0.484s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:27 devstack sudo[93051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 Sep 18 00:37:27 devstack sudo[93051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:27 devstack sudo[93051]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8" returned: 0 in 0.285s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:27 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 is being set with open permissions: ugo+rw Sep 18 00:37:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:27 devstack sudo[93056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 Sep 18 00:37:27 devstack sudo[93056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:28 devstack sudo[93056]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8" returned: 0 in 0.390s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.796s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0d2a0def-468c-4106-b87b-e4c51bfa3137 tempest-VolumesDeleteCascade-1613233050 None] Create snapshot completed successfully Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-488d456c-c408-4005-9bcb-7a487ee88d6e-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-488d456c-c408-4005-9bcb-7a487ee88d6e-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Performing cascade delete. {{(pid=86526) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-3f9c46d5-60ef-424a-86e2-545628f2ffd8-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-3f9c46d5-60ef-424a-86e2-545628f2ffd8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-3f9c46d5-60ef-424a-86e2-545628f2ffd8" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-3f9c46d5-60ef-424a-86e2-545628f2ffd8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Deleting offline snapshot 3f9c46d5-60ef-424a-86e2-545628f2ffd8 of volume 488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] snapshot_file for this snap is: volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[798dcfc2-1117-4ebb-b3f8-cefe2a0657a2]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:28 devstack sudo[93059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 Sep 18 00:37:28 devstack sudo[93059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:29 devstack sudo[93059]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8" returned: 0 in 0.445s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488d456c-c408-4005-9bcb-7a487ee88d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:37:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eb98052-8ac5-490d-9048-fefc891a157c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:29 devstack sudo[93064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 Sep 18 00:37:29 devstack sudo[93064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:29 devstack sudo[93064]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613" returned: 0 in 0.482s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488d456c-c408-4005-9bcb-7a487ee88d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:37:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:29 devstack sudo[93069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 Sep 18 00:37:29 devstack sudo[93069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:30 devstack sudo[93069]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8" returned: 0 in 0.499s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:30 devstack sudo[93076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8 Sep 18 00:37:30 devstack sudo[93076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:30 devstack sudo[93076]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.3f9c46d5-60ef-424a-86e2-545628f2ffd8" returned: 0 in 0.366s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-3f9c46d5-60ef-424a-86e2-545628f2ffd8" released by "_delete_snapshot" :: held 1.934s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" released by "delete_snapshot" :: held 1.958s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=97,cinder:SELECT=87,cinder:INSERT=26,cinder:DELETE=6 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=89,cinder:SELECT=80,cinder:DELETE=11,cinder:INSERT=40 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:37:30 devstack cinder-volume[86526]: WARNING cinder.quota [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Created reservations ['77725da6-226b-4c1f-bcf1-09ee1f38bb6a', 'ad042dea-1b97-4092-9232-c755636d2f23', '8c8cbc17-f93d-4016-b573-b468107e1239', 'a02df8c0-b914-4aa4-9d54-69a75480f605'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:30 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Delete snapshot completed successfully. Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-3f9c46d5-60ef-424a-86e2-545628f2ffd8-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-cc978ea8-3f8c-4837-aef8-febfde6f6613-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-cc978ea8-3f8c-4837-aef8-febfde6f6613-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-cc978ea8-3f8c-4837-aef8-febfde6f6613" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-cc978ea8-3f8c-4837-aef8-febfde6f6613" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Deleting offline snapshot cc978ea8-3f8c-4837-aef8-febfde6f6613 of volume 488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] snapshot_file for this snap is: volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[44ff06f1-5c39-404e-9721-db8004190bc1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:31 devstack sudo[93081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 Sep 18 00:37:31 devstack sudo[93081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:31 devstack sudo[93081]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613" returned: 0 in 0.396s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-488d456c-c408-4005-9bcb-7a487ee88d6e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:37:31 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[664ff35d-b997-4c6b-a223-55f43c701aff]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:31 devstack sudo[93086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e Sep 18 00:37:31 devstack sudo[93086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:31 devstack sudo[93086]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e" returned: 0 in 0.441s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:31 devstack sudo[93091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 Sep 18 00:37:31 devstack sudo[93091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:32 devstack sudo[93091]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613" returned: 0 in 0.466s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:32 devstack sudo[93096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613 Sep 18 00:37:32 devstack sudo[93096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:32 devstack sudo[93096]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e.cc978ea8-3f8c-4837-aef8-febfde6f6613" returned: 0 in 0.269s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-cc978ea8-3f8c-4837-aef8-febfde6f6613" released by "_delete_snapshot" :: held 1.732s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" released by "delete_snapshot" :: held 1.760s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Created reservations ['13e90a8c-2f8b-49bb-98d9-5e3bd91d1dfd', 'fec7005e-fb4b-42f2-a9c1-8e8944e8ece4', '85bf7228-94cf-43b5-a98a-93a3511c9060', 'f433cebc-dab0-4325-94b7-61ec3cfb3294'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Delete snapshot completed successfully. Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-cc978ea8-3f8c-4837-aef8-febfde6f6613-delete_snapshot" released by "delete_snapshot" :: held 1.964s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Snapshots deleted, issuing volume delete {{(pid=86526) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[90e71d7f-d24d-445a-9daa-1751c0ff18bc]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:33 devstack sudo[93099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e Sep 18 00:37:33 devstack sudo[93099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:33 devstack sudo[93099]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e" returned: 0 in 0.478s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:33 devstack sudo[93104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e Sep 18 00:37:33 devstack sudo[93104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:33 devstack sudo[93104]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-488d456c-c408-4005-9bcb-7a487ee88d6e" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-488d456c-c408-4005-9bcb-7a487ee88d6e" released by "delete_volume" :: held 0.968s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:33 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Created reservations ['fbe6931d-7b6c-4b82-8993-c1f8c01bdd13', '43738dc0-14e0-439c-b11b-7315bc45583b', '11ea19f2-fb4c-472f-a51f-61744128404d', 'e211bced-0a0f-4032-810a-4f2d1e5e4ad0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:34 devstack sudo[93107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:37:34 devstack sudo[93107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:34 devstack sudo[93107]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:37:34 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Deleted volume successfully. Sep 18 00:37:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9c33250c-cdc6-48e6-95bf-3275564d710a tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-488d456c-c408-4005-9bcb-7a487ee88d6e-delete_volume" released by "delete_volume" :: held 5.772s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Flow 'volume_create_manager' (ce6acf65-3192-4eca-ac97-340a21b0d973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3fe14c-d96f-4544-8a30-0526746a9c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa3fe14c-d96f-4544-8a30-0526746a9c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101304369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d90e99-51dd-42a1-bb88-4c49a26eb197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6201ca72fa0b425bb9c1292b5384db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:36Z,use_quota=True,user_id='a3845bffed734ed9a1c1868b7384afd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388b468f-738f-40ff-a9bb-44c0759568c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (388b468f-738f-40ff-a9bb-44c0759568c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4af3b4-2c31-4563-9ad6-17c140cf3e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d4af3b4-2c31-4563-9ad6-17c140cf3e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d90e99-51dd-42a1-bb88-4c49a26eb197', 'volume_name': 'volume-84d90e99-51dd-42a1-bb88-4c49a26eb197', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488e14da-2b5d-45f0-8e3c-7d40c401c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (488e14da-2b5d-45f0-8e3c-7d40c401c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a43f6e5-2de2-4402-92da-7ed043c42853) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Volume 84d90e99-51dd-42a1-bb88-4c49a26eb197: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d90e99-51dd-42a1-bb88-4c49a26eb197', 'volume_size': 1} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1101304369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d90e99-51dd-42a1-bb88-4c49a26eb197,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6201ca72fa0b425bb9c1292b5384db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:36Z,use_quota=True,user_id='a3845bffed734ed9a1c1868b7384afd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Creating volume 84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:37:35 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:37:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:35 devstack sudo[93111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 1073741824 Sep 18 00:37:35 devstack sudo[93111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:36 devstack sudo[93111]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 1073741824" returned: 0 in 0.631s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:36 devstack sudo[93119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 Sep 18 00:37:36 devstack sudo[93119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:36 devstack sudo[93119]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197" returned: 0 in 0.334s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] <== create_volume: return (1027ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a43f6e5-2de2-4402-92da-7ed043c42853) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d90e99-51dd-42a1-bb88-4c49a26eb197', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0bbc08-e443-4c76-85a7-e83537436225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:36 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Volume volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 (84d90e99-51dd-42a1-bb88-4c49a26eb197): created successfully Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa0bbc08-e443-4c76-85a7-e83537436225) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Flow 'volume_create_manager' (ce6acf65-3192-4eca-ac97-340a21b0d973) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-aa9f5e9a-312a-41d1-8a24-a64d9aa565fe tempest-VolumesDeleteCascade-1613233050 None] Created volume successfully. Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (1532e518-32d3-4337-9b85-ac10ee041146) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90c0929-2e1c-43c2-a2e2-d5d7c348d64d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d90c0929-2e1c-43c2-a2e2-d5d7c348d64d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-590516893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8f4abf-6c8a-4b56-991b-441a8e473d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:37Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfadd233-b3b5-4c8b-b231-5368323ac9f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cfadd233-b3b5-4c8b-b231-5368323ac9f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae62c5b6-3b78-43d7-a030-f431e845d814) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae62c5b6-3b78-43d7-a030-f431e845d814) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0f8f4abf-6c8a-4b56-991b-441a8e473d86', 'volume_name': 'volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e94d93c-d459-47a7-ad44-80364561ebe9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e94d93c-d459-47a7-ad44-80364561ebe9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe7f4aa-a55e-41d3-95ea-999b044c8c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Volume 0f8f4abf-6c8a-4b56-991b-441a8e473d86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86', 'volume_size': 1} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-590516893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0f8f4abf-6c8a-4b56-991b-441a8e473d86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:37Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Creating volume 0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:37:37 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:37 devstack sudo[93122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 1073741824 Sep 18 00:37:37 devstack sudo[93122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:37 devstack sudo[93122]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 1073741824" returned: 0 in 0.588s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:37 devstack sudo[93128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 Sep 18 00:37:37 devstack sudo[93128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:38 devstack sudo[93128]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86" returned: 0 in 0.286s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] <== create_volume: return (934ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.249s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fe7f4aa-a55e-41d3-95ea-999b044c8c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba744507-65a3-4225-9591-82aa8f69a113) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Creating offline snapshot 489f3cf5-5814-4aef-8a9c-f82f08a84be1 of volume 84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:37:38 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Volume volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 (0f8f4abf-6c8a-4b56-991b-441a8e473d86): created successfully Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ba744507-65a3-4225-9591-82aa8f69a113) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (1532e518-32d3-4337-9b85-ac10ee041146) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4a351e3-0002-4757-affb-40862f50c15a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2abafda2-61a0-4170-9cd9-a35fc7ee385b tempest-VolumesSnapshotTestJSON-2117124607 None] Created volume successfully. Sep 18 00:37:38 devstack sudo[93131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 Sep 18 00:37:38 devstack sudo[93131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:38 devstack sudo[93131]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197" returned: 0 in 0.427s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:38 devstack sudo[93138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 1G Sep 18 00:37:38 devstack sudo[93138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:39 devstack sudo[93138]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 1G" returned: 0 in 0.489s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:39 devstack sudo[93147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 Sep 18 00:37:39 devstack sudo[93147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:39 devstack sudo[93147]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1" returned: 0 in 0.379s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:39 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 is being set with open permissions: ugo+rw Sep 18 00:37:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:39 devstack sudo[93153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 Sep 18 00:37:39 devstack sudo[93153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:40 devstack sudo[93153]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1" returned: 0 in 0.486s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:40 devstack sudo[93156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.info Sep 18 00:37:40 devstack sudo[93156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:40 devstack sudo[93156]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.info" returned: 0 in 0.347s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:40 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.info is being set with open permissions: ugo+rw Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:40 devstack sudo[93162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.info Sep 18 00:37:40 devstack sudo[93162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:40 devstack sudo[93162]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.info" returned: 0 in 0.279s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.560s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.622s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Creating offline snapshot da426826-f0d7-4f63-84c5-a2dcc960cdee of volume 0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:37:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-34b141eb-4db9-43ea-ab1c-f2e268ed7eb1 tempest-VolumesDeleteCascade-1613233050 None] Create snapshot completed successfully Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[053b85a9-78c5-4c56-ac26-7d268a8291f4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:40 devstack sudo[93165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 Sep 18 00:37:40 devstack sudo[93165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:41 devstack sudo[93165]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86" returned: 0 in 0.578s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:41 devstack sudo[93171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee 1G Sep 18 00:37:41 devstack sudo[93171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:41 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Flow 'volume_create_manager' (8017752c-8059-4d7a-930c-209c28770bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7595381e-a924-4bd3-9328-1910fcc65595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7595381e-a924-4bd3-9328-1910fcc65595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-600364643',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59d81d0c-eebc-479f-841b-fb86a8ac0b0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6201ca72fa0b425bb9c1292b5384db67',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=489f3cf5-5814-4aef-8a9c-f82f08a84be1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:42Z,use_quota=True,user_id='a3845bffed734ed9a1c1868b7384afd7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11090898-f6c1-4ba2-a0bc-2a06f4e8b4fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11090898-f6c1-4ba2-a0bc-2a06f4e8b4fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8bc33d-3c88-4163-a012-930f092cd0b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f8bc33d-3c88-4163-a012-930f092cd0b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '59d81d0c-eebc-479f-841b-fb86a8ac0b0f', 'volume_name': 'volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f', 'volume_size': 1, 'snapshot_id': '489f3cf5-5814-4aef-8a9c-f82f08a84be1'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d202d8-3b33-4d3b-b680-caf6036e85bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (28d202d8-3b33-4d3b-b680-caf6036e85bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffc8d96-7e19-4b91-8f36-a2178fb3c21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:42 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Volume 59d81d0c-eebc-479f-841b-fb86a8ac0b0f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f', 'volume_size': 1, 'snapshot_id': '489f3cf5-5814-4aef-8a9c-f82f08a84be1'} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:42 devstack sudo[93171]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee 1G" returned: 0 in 0.751s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:42 devstack sudo[93189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee Sep 18 00:37:42 devstack sudo[93189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:42 devstack sudo[93189]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee" returned: 0 in 0.341s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:42 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee is being set with open permissions: ugo+rw Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:42 devstack sudo[93196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee Sep 18 00:37:42 devstack sudo[93196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:42 devstack sudo[93196]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:42 devstack sudo[93199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.info Sep 18 00:37:42 devstack sudo[93199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:43 devstack sudo[93199]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.info" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:43 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.info is being set with open permissions: ugo+rw Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:43 devstack sudo[93202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.info Sep 18 00:37:43 devstack sudo[93202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:43 devstack sudo[93202]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.info" returned: 0 in 0.377s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.727s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.379s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-489f3cf5-5814-4aef-8a9c-f82f08a84be1-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-489f3cf5-5814-4aef-8a9c-f82f08a84be1-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" acquired by "_create_volume_from_snapshot" :: waited 0.031s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Creating volume 59d81d0c-eebc-479f-841b-fb86a8ac0b0f from snapshot 489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] snapshot: 489f3cf5-5814-4aef-8a9c-f82f08a84be1, volume: 59d81d0c-eebc-479f-841b-fb86a8ac0b0f, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-605498fb-161b-4e94-8176-b264cb2ad6b5 tempest-VolumesSnapshotTestJSON-2117124607 None] Create snapshot completed successfully Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ce265b2-5917-4588-93fc-a83a372d0413]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:43 devstack sudo[93207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 Sep 18 00:37:43 devstack sudo[93207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:44 devstack sudo[93207]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1" returned: 0 in 0.479s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d90e99-51dd-42a1-bb88-4c49a26eb197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd76ef95-9983-4adc-b754-d7a0a9d3fad6]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:44 devstack sudo[93214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 Sep 18 00:37:44 devstack sudo[93214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:44 devstack sudo[93214]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197" returned: 0 in 0.550s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-da426826-f0d7-4f63-84c5-a2dcc960cdee-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-da426826-f0d7-4f63-84c5-a2dcc960cdee-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:44 devstack sudo[93219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f Sep 18 00:37:44 devstack sudo[93219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-0f8f4abf-6c8a-4b56-991b-441a8e473d86" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-0f8f4abf-6c8a-4b56-991b-441a8e473d86" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-da426826-f0d7-4f63-84c5-a2dcc960cdee" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-da426826-f0d7-4f63-84c5-a2dcc960cdee" acquired by "_delete_snapshot" :: waited 0.093s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Deleting offline snapshot da426826-f0d7-4f63-84c5-a2dcc960cdee of volume 0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:37:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] snapshot_file for this snap is: volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:37:45 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6dca9619-afde-43c4-a711-c6894b6b6e00]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:45 devstack sudo[93236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee Sep 18 00:37:45 devstack sudo[93236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:46 devstack sudo[93236]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee" returned: 0 in 0.994s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:37:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4fe05d4-1fbc-4443-a1be-c6e030b791c1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:46 devstack sudo[93300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 Sep 18 00:37:46 devstack sudo[93300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:47 devstack sudo[93300]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86" returned: 0 in 1.287s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:47 devstack sudo[93310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee Sep 18 00:37:47 devstack sudo[93310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:48 devstack sudo[93310]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee" returned: 0 in 1.220s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:48 devstack sudo[93316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee Sep 18 00:37:48 devstack sudo[93316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:49 devstack sudo[93316]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86.da426826-f0d7-4f63-84c5-a2dcc960cdee" returned: 0 in 0.873s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-da426826-f0d7-4f63-84c5-a2dcc960cdee" released by "_delete_snapshot" :: held 4.916s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-0f8f4abf-6c8a-4b56-991b-441a8e473d86" released by "delete_snapshot" :: held 5.046s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:50 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['32e9270e-fb76-4db6-a902-1a516113af65', '15c05445-4b40-42cc-8b38-f31db26df185', '54545fa1-8ede-4abb-8873-9cd7af26d901', '2d91075a-18a2-4c21-ac46-fd90888f94ff'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:37:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Delete snapshot completed successfully. Sep 18 00:37:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0389bef1-b67a-4c60-b486-454094d6cc4e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-da426826-f0d7-4f63-84c5-a2dcc960cdee-delete_snapshot" released by "delete_snapshot" :: held 5.579s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (ca6bc9f7-7212-43e7-a10d-edd968323c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61743ef9-0b0d-41cd-85ac-539732e163b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61743ef9-0b0d-41cd-85ac-539732e163b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-413677394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54be513c-f7d1-40a9-90f8-4aefaba6e2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:53Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6927ea57-4e54-4be9-bdc8-8b5bdedbefa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6927ea57-4e54-4be9-bdc8-8b5bdedbefa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b578e670-3589-429d-b481-58fb25fed033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b578e670-3589-429d-b481-58fb25fed033) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54be513c-f7d1-40a9-90f8-4aefaba6e2fd', 'volume_name': 'volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b082c0f-cad9-472a-8450-6835e6078392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b082c0f-cad9-472a-8450-6835e6078392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c26509d-7a77-45d3-ab16-ba1c83b515f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:52 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Volume 54be513c-f7d1-40a9-90f8-4aefaba6e2fd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd', 'volume_size': 1} Sep 18 00:37:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:57 devstack sudo[93219]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" returned: 0 in 12.466s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197, size 1024.00 MB, duration 12.47 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:37:57 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Converted 1024.00 MB image at 82.12 MB/s Sep 18 00:37:57 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f is being set with open permissions: ugo+rw Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:57 devstack sudo[93357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f Sep 18 00:37:57 devstack sudo[93357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:57 devstack sudo[93357]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" returned: 0 in 0.349s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" released by "_copy_volume_from_snapshot" :: held 13.974s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-489f3cf5-5814-4aef-8a9c-f82f08a84be1-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" released by "_create_volume_from_snapshot" :: held 14.082s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.115s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.706s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:37:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-413677394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=54be513c-f7d1-40a9-90f8-4aefaba6e2fd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:37:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:37:53Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Creating volume 54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:37:57 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:57 devstack sudo[93360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd 1073741824 Sep 18 00:37:57 devstack sudo[93360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ffc8d96-7e19-4b91-8f36-a2178fb3c21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f', 'volume_size': 1, 'snapshot_id': '489f3cf5-5814-4aef-8a9c-f82f08a84be1'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a6e69f-f84e-4765-8050-ed5c32e79dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:57 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Volume volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f (59d81d0c-eebc-479f-841b-fb86a8ac0b0f): created successfully Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6a6e69f-f84e-4765-8050-ed5c32e79dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Flow 'volume_create_manager' (8017752c-8059-4d7a-930c-209c28770bbf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:57 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f7640910-41c3-4829-9f2d-a5726fc7184c tempest-VolumesDeleteCascade-1613233050 None] Created volume successfully. Sep 18 00:37:58 devstack sudo[93360]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd 1073741824" returned: 0 in 0.834s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-84d90e99-51dd-42a1-bb88-4c49a26eb197-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-84d90e99-51dd-42a1-bb88-4c49a26eb197-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:58 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd Sep 18 00:37:58 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Performing cascade delete. {{(pid=86526) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-489f3cf5-5814-4aef-8a9c-f82f08a84be1-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-489f3cf5-5814-4aef-8a9c-f82f08a84be1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-84d90e99-51dd-42a1-bb88-4c49a26eb197" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-84d90e99-51dd-42a1-bb88-4c49a26eb197" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-489f3cf5-5814-4aef-8a9c-f82f08a84be1" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-489f3cf5-5814-4aef-8a9c-f82f08a84be1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Deleting offline snapshot 489f3cf5-5814-4aef-8a9c-f82f08a84be1 of volume 84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] snapshot_file for this snap is: volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae1d32ba-14c1-4919-b939-85fc64971e13]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:59 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" returned: 0 in 0.542s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] <== create_volume: return (1482ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.486s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:37:59 devstack sudo[93369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 Sep 18 00:37:59 devstack sudo[93369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8c26509d-7a77-45d3-ab16-ba1c83b515f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb0228c-1772-49e6-bcf9-15140dff34b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:37:59 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Volume volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd (54be513c-f7d1-40a9-90f8-4aefaba6e2fd): created successfully Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (afb0228c-1772-49e6-bcf9-15140dff34b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (ca6bc9f7-7212-43e7-a10d-edd968323c6e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:37:59 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4556bb9d-60fb-446f-86bb-cdd716e201ed tempest-VolumesSnapshotTestJSON-2117124607 None] Created volume successfully. Sep 18 00:37:59 devstack sudo[93369]: pam_unix(sudo:session): session closed for user root Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1" returned: 0 in 0.674s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d90e99-51dd-42a1-bb88-4c49a26eb197(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3416786-8d2b-4fd9-8d95-1bbb15cfc6b3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:37:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:37:59 devstack sudo[93378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 Sep 18 00:37:59 devstack sudo[93378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:00 devstack sudo[93378]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197" returned: 0 in 0.794s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:00 devstack sudo[93385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 Sep 18 00:38:00 devstack sudo[93385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Creating offline snapshot 057e7cd8-1073-471e-8cd8-42e65deb7968 of volume 54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa0b71f5-4fad-4849-a5da-8c19cc9d8ff2]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:00 devstack sudo[93385]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1" returned: 0 in 0.583s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:00 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd Sep 18 00:38:00 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:00 devstack sudo[93393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1 Sep 18 00:38:00 devstack sudo[93393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:01 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" returned: 0 in 0.699s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:01 devstack sudo[93393]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197.489f3cf5-5814-4aef-8a9c-f82f08a84be1" returned: 0 in 0.474s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:01 devstack sudo[93425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 1G Sep 18 00:38:01 devstack sudo[93425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-489f3cf5-5814-4aef-8a9c-f82f08a84be1" released by "_delete_snapshot" :: held 2.688s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-84d90e99-51dd-42a1-bb88-4c49a26eb197" released by "delete_snapshot" :: held 2.725s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Created reservations ['9fcdf4a1-d5e9-4e87-91e0-26fa00799082', '4838239c-8d6e-4dc2-8d2a-c9004aec7525', 'c1474ee3-a0f9-4a5f-8e7e-02bf2072573f', 'e39b1455-7d68-4e8f-a43a-20502f25f8f4'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:01 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Delete snapshot completed successfully. Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-489f3cf5-5814-4aef-8a9c-f82f08a84be1-delete_snapshot" released by "delete_snapshot" :: held 3.028s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Snapshots deleted, issuing volume delete {{(pid=86526) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-84d90e99-51dd-42a1-bb88-4c49a26eb197" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-84d90e99-51dd-42a1-bb88-4c49a26eb197" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[26dc8a69-d04d-4c5c-9608-25b582d98dec]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:01 devstack sudo[93439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 Sep 18 00:38:01 devstack sudo[93439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:02 devstack sudo[93425]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 1G" returned: 0 in 0.716s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:02 devstack sudo[93445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 Sep 18 00:38:02 devstack sudo[93445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:02 devstack sudo[93439]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197" returned: 0 in 0.422s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:02 devstack sudo[93450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197 Sep 18 00:38:02 devstack sudo[93450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:02 devstack sudo[93445]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968" returned: 0 in 0.330s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:02 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 is being set with open permissions: ugo+rw Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:02 devstack sudo[93455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 Sep 18 00:38:02 devstack sudo[93455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:02 devstack sudo[93450]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d90e99-51dd-42a1-bb88-4c49a26eb197" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-84d90e99-51dd-42a1-bb88-4c49a26eb197" released by "delete_volume" :: held 0.779s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Created reservations ['674d3a06-5a5e-461c-8cf8-a259e6aa7bc6', '00a44608-f793-4195-9257-2d6903960b90', '2595cc6b-b459-4d18-a8a5-603894bb6664', '14bc86c2-2d3e-4921-bcbf-285465c861ef'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:02 devstack sudo[93459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:02 devstack sudo[93459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:02 devstack sudo[93455]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968" returned: 0 in 0.348s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:02 devstack sudo[93461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.info Sep 18 00:38:02 devstack sudo[93461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:02 devstack sudo[93459]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.282s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:02 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:02 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Deleted volume successfully. Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3503eb0a-e46e-4dda-b50a-083575059d32 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-84d90e99-51dd-42a1-bb88-4c49a26eb197-delete_volume" released by "delete_volume" :: held 4.478s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:03 devstack sudo[93461]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.info" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:03 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.info is being set with open permissions: ugo+rw Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:03 devstack sudo[93465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.info Sep 18 00:38:03 devstack sudo[93465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-59d81d0c-eebc-479f-841b-fb86a8ac0b0f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-59d81d0c-eebc-479f-841b-fb86a8ac0b0f-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "cinder-quobyte-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:03 devstack sudo[93465]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.info" returned: 0 in 0.309s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.864s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" acquired by "delete_volume" :: waited 0.047s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[724bbd2c-9ad3-4a28-af7d-6f82d4e9d749]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:03 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b262faa7-4967-451d-8446-ea65ce5c7df7 tempest-VolumesSnapshotTestJSON-2117124607 None] Create snapshot completed successfully Sep 18 00:38:03 devstack sudo[93469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f Sep 18 00:38:03 devstack sudo[93469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:03 devstack sudo[93469]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" returned: 0 in 0.424s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:03 devstack sudo[93476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f Sep 18 00:38:03 devstack sudo[93476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:04 devstack sudo[93476]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" returned: 0 in 0.546s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:04 devstack sudo[93510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:04 devstack sudo[93510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-quobyte-59d81d0c-eebc-479f-841b-fb86a8ac0b0f" released by "delete_volume" :: held 1.056s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Created reservations ['57a4bcef-a7b8-4e4a-b2aa-fced0606c0fc', 'c8a6179c-5011-41cc-9d50-fbda1dbf11eb', '03f70b48-971e-4d58-8b53-89beef7a84a7', '3de3dc02-95f9-483a-8cd1-942ba3c4598b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (03e3b36a-ecf6-4f50-b7e8-91ef054c4875) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a77477-b01f-4062-9219-000c2d033e1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61a77477-b01f-4062-9219-000c2d033e1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-291496678',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=21591628-1884-4e3b-a9c9-2d06873f12fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:04Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=057e7cd8-1073-471e-8cd8-42e65deb7968,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:04Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfbfb46-8f63-4b73-92a3-445accca5a13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8dfbfb46-8f63-4b73-92a3-445accca5a13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5a9146-2b24-4fc8-9c1e-dbde21e2f257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae5a9146-2b24-4fc8-9c1e-dbde21e2f257) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '21591628-1884-4e3b-a9c9-2d06873f12fc', 'volume_name': 'volume-21591628-1884-4e3b-a9c9-2d06873f12fc', 'volume_size': 2, 'snapshot_id': '057e7cd8-1073-471e-8cd8-42e65deb7968'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7812db-2e59-4746-9dc8-9d9fafc348f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d7812db-2e59-4746-9dc8-9d9fafc348f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b156162f-e90a-4bf8-ac9d-ff74036b8c3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:04 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Volume 21591628-1884-4e3b-a9c9-2d06873f12fc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-21591628-1884-4e3b-a9c9-2d06873f12fc', 'volume_size': 2, 'snapshot_id': '057e7cd8-1073-471e-8cd8-42e65deb7968'} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-057e7cd8-1073-471e-8cd8-42e65deb7968-21591628-1884-4e3b-a9c9-2d06873f12fc" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:04 devstack sudo[93510]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.494s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-057e7cd8-1073-471e-8cd8-42e65deb7968-21591628-1884-4e3b-a9c9-2d06873f12fc" acquired by "_create_volume_from_snapshot" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Creating volume 21591628-1884-4e3b-a9c9-2d06873f12fc from snapshot 057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-21591628-1884-4e3b-a9c9-2d06873f12fc" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-21591628-1884-4e3b-a9c9-2d06873f12fc" acquired by "_copy_volume_from_snapshot" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] snapshot: 057e7cd8-1073-471e-8cd8-42e65deb7968, volume: 21591628-1884-4e3b-a9c9-2d06873f12fc, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[cde2ac57-3175-4f52-ba66-22b045eaa882]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:05 devstack sudo[93544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:05 devstack sudo[93544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:05 devstack sudo[93543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 Sep 18 00:38:05 devstack sudo[93543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:05 devstack sudo[93544]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.395s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:05 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Deleted volume successfully. Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6270661-c312-457a-8efc-59d5ae61f479 tempest-VolumesDeleteCascade-1613233050 None] Lock "cinder-59d81d0c-eebc-479f-841b-fb86a8ac0b0f-delete_volume" released by "delete_volume" :: held 2.231s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:05 devstack sudo[93543]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968" returned: 0 in 0.649s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[34fb5279-d694-4e2c-8c22-d9f2d6d10aa0]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:05 devstack sudo[93557]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd Sep 18 00:38:05 devstack sudo[93557]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:06 devstack sudo[93557]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" returned: 0 in 0.564s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:38:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:38:06 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:38:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:06 devstack sudo[93564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc Sep 18 00:38:06 devstack sudo[93564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:15 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=69,cinder:INSERT=21,cinder:UPDATE=55,cinder:DELETE=7 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:38:15 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:INSERT=14,cinder:UPDATE=72,cinder:SELECT=55,cinder:DELETE=3 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:38:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Flow 'volume_create_manager' (a31afae8-d935-41a3-b6ee-f29d9b4fb04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3900256d-c120-452a-897b-bdd8797ffe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3900256d-c120-452a-897b-bdd8797ffe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-298027725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d1d57b-fd2b-491e-b622-15eb42985666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610772a6c61e48f282e54d4327d54d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:16Z,use_quota=True,user_id='37979e4a9d884b02927241016f578be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7b69f1-3a5e-4046-be06-a19c9978717c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9f7b69f1-3a5e-4046-be06-a19c9978717c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285712b1-b0df-45a1-be37-b314677e8b09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (285712b1-b0df-45a1-be37-b314677e8b09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33d1d57b-fd2b-491e-b622-15eb42985666', 'volume_name': 'volume-33d1d57b-fd2b-491e-b622-15eb42985666', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89063a1e-191f-4744-b8a8-8562f46a2f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (89063a1e-191f-4744-b8a8-8562f46a2f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3325b076-9d92-44d0-a6a9-a1f733a9862d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Volume 33d1d57b-fd2b-491e-b622-15eb42985666: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33d1d57b-fd2b-491e-b622-15eb42985666', 'volume_size': 1} Sep 18 00:38:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc" returned: 0 in 12.298s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:18 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd, size 1024.00 MB, duration 12.30 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:38:18 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Converted 1024.00 MB image at 83.25 MB/s Sep 18 00:38:18 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc is being set with open permissions: ugo+rw Sep 18 00:38:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:18 devstack sudo[93612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc Sep 18 00:38:18 devstack sudo[93612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:18 devstack sudo[93612]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc" returned: 0 in 0.403s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-21591628-1884-4e3b-a9c9-2d06873f12fc" released by "_copy_volume_from_snapshot" :: held 14.074s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-057e7cd8-1073-471e-8cd8-42e65deb7968-21591628-1884-4e3b-a9c9-2d06873f12fc" released by "_create_volume_from_snapshot" :: held 14.223s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.270s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.981s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-298027725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33d1d57b-fd2b-491e-b622-15eb42985666,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610772a6c61e48f282e54d4327d54d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:16Z,use_quota=True,user_id='37979e4a9d884b02927241016f578be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Creating volume 33d1d57b-fd2b-491e-b622-15eb42985666 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:19 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:19 devstack sudo[93615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 1073741824 Sep 18 00:38:19 devstack sudo[93615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b156162f-e90a-4bf8-ac9d-ff74036b8c3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-21591628-1884-4e3b-a9c9-2d06873f12fc', 'volume_size': 2, 'snapshot_id': '057e7cd8-1073-471e-8cd8-42e65deb7968'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51ea655-610f-446b-9e66-566c74b7deaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Volume volume-21591628-1884-4e3b-a9c9-2d06873f12fc (21591628-1884-4e3b-a9c9-2d06873f12fc): created successfully Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51ea655-610f-446b-9e66-566c74b7deaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (03e3b36a-ecf6-4f50-b7e8-91ef054c4875) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-92aa180d-a51f-4830-867b-ebe9a117d78e tempest-VolumesSnapshotTestJSON-2117124607 None] Created volume successfully. Sep 18 00:38:19 devstack sudo[93615]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 1073741824" returned: 0 in 0.627s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:19 devstack sudo[93622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 Sep 18 00:38:19 devstack sudo[93622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Flow 'volume_create_manager' (79b05329-c4d8-41b9-8d81-0ad40199d3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62a7c28-96f4-46a9-9d5f-93871ca1a8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-21591628-1884-4e3b-a9c9-2d06873f12fc-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-21591628-1884-4e3b-a9c9-2d06873f12fc-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:20 devstack sudo[93622]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a62a7c28-96f4-46a9-9d5f-93871ca1a8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-612215747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f97142-359f-42bf-9ea0-3907f023d4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67c1ddde11142fd81195e867093a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:20Z,use_quota=True,user_id='b2f0c98cc77c4a3497a35c51397a0978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d577de6-39b0-4f90-b185-61f6590959c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d577de6-39b0-4f90-b185-61f6590959c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc454bf7-2eaa-46c4-a066-ff25fc8aeffd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc454bf7-2eaa-46c4-a066-ff25fc8aeffd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '26f97142-359f-42bf-9ea0-3907f023d4eb', 'volume_name': 'volume-26f97142-359f-42bf-9ea0-3907f023d4eb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b976abad-d2ef-43b4-b83d-0b70b22966e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b976abad-d2ef-43b4-b83d-0b70b22966e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beed6996-89c3-4b14-b5b9-9b4d3891f55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Volume 26f97142-359f-42bf-9ea0-3907f023d4eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-26f97142-359f-42bf-9ea0-3907f023d4eb', 'volume_size': 1} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666" returned: 0 in 0.892s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] <== create_volume: return (1590ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.593s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.037s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-612215747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=26f97142-359f-42bf-9ea0-3907f023d4eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67c1ddde11142fd81195e867093a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:20Z,use_quota=True,user_id='b2f0c98cc77c4a3497a35c51397a0978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Creating volume 26f97142-359f-42bf-9ea0-3907f023d4eb {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:20 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3325b076-9d92-44d0-a6a9-a1f733a9862d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33d1d57b-fd2b-491e-b622-15eb42985666', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:20 devstack sudo[93676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb 1073741824 Sep 18 00:38:20 devstack sudo[93676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90eb1102-cc03-498c-9e4d-fe6f710694cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Volume volume-33d1d57b-fd2b-491e-b622-15eb42985666 (33d1d57b-fd2b-491e-b622-15eb42985666): created successfully Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (90eb1102-cc03-498c-9e4d-fe6f710694cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Flow 'volume_create_manager' (a31afae8-d935-41a3-b6ee-f29d9b4fb04c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-21591628-1884-4e3b-a9c9-2d06873f12fc" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-99c669c4-72d7-4e28-ae85-0a20cd10237c tempest-AttachVolumeTestJSON-1494072351 None] Created volume successfully. Sep 18 00:38:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-21591628-1884-4e3b-a9c9-2d06873f12fc" acquired by "delete_volume" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:21 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ab7b98c-0ad6-4d6c-b56b-6f8fc7512233]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:21 devstack sudo[93693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc Sep 18 00:38:21 devstack sudo[93693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:21 devstack sudo[93676]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb 1073741824" returned: 0 in 0.948s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:21 devstack sudo[93693]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc" returned: 0 in 0.721s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:21 devstack sudo[93712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc Sep 18 00:38:21 devstack sudo[93712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:21 devstack sudo[93714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb Sep 18 00:38:21 devstack sudo[93714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:22 devstack sudo[93714]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb" returned: 0 in 0.407s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] <== create_volume: return (1490ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.496s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:22 devstack sudo[93712]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-21591628-1884-4e3b-a9c9-2d06873f12fc" returned: 0 in 0.484s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (beed6996-89c3-4b14-b5b9-9b4d3891f55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-26f97142-359f-42bf-9ea0-3907f023d4eb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93be5abf-01b8-4fee-8c88-8112e9ae5a6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-21591628-1884-4e3b-a9c9-2d06873f12fc" released by "delete_volume" :: held 1.314s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Volume volume-26f97142-359f-42bf-9ea0-3907f023d4eb (26f97142-359f-42bf-9ea0-3907f023d4eb): created successfully Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (93be5abf-01b8-4fee-8c88-8112e9ae5a6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Flow 'volume_create_manager' (79b05329-c4d8-41b9-8d81-0ad40199d3d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8a55206f-07c6-489d-a2d8-1eb6e9e1db8d tempest-VolumesTransfersTest-122704499 None] Created volume successfully. Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['8eef4676-6f2b-4f21-bff9-4eeb050ba74a', 'f0e38f12-3e91-4697-853b-73a219832185', '2228b579-76dc-4b54-abd4-0d8e6530d31b', '23b3e067-c1e3-4c93-87d0-ccde4d68a1a3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:22 devstack sudo[93729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:22 devstack sudo[93729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-3d0d9f51-b756-4a51-8c45-575ef375ee8f req-6bb38f3b-1434-4f49-97ac-b1aef51eb561 tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-3d0d9f51-b756-4a51-8c45-575ef375ee8f req-6bb38f3b-1434-4f49-97ac-b1aef51eb561 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-3d0d9f51-b756-4a51-8c45-575ef375ee8f req-6bb38f3b-1434-4f49-97ac-b1aef51eb561 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-3d0d9f51-b756-4a51-8c45-575ef375ee8f req-6bb38f3b-1434-4f49-97ac-b1aef51eb561 tempest-AttachVolumeTestJSON-1494072351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-33d1d57b-fd2b-491e-b622-15eb42985666', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'afb24f1e-7142-4990-892d-b1dcbb8959e3', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:38:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-3d0d9f51-b756-4a51-8c45-575ef375ee8f req-6bb38f3b-1434-4f49-97ac-b1aef51eb561 tempest-AttachVolumeTestJSON-1494072351 None] attachment_update completed successfully. Sep 18 00:38:22 devstack sudo[93729]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Deleted volume successfully. Sep 18 00:38:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8261835a-7350-4adc-a345-9a80faffa194 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-21591628-1884-4e3b-a9c9-2d06873f12fc-delete_volume" released by "delete_volume" :: held 2.381s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-057e7cd8-1073-471e-8cd8-42e65deb7968-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-057e7cd8-1073-471e-8cd8-42e65deb7968-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-057e7cd8-1073-471e-8cd8-42e65deb7968" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-057e7cd8-1073-471e-8cd8-42e65deb7968" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Deleting offline snapshot 057e7cd8-1073-471e-8cd8-42e65deb7968 of volume 54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] snapshot_file for this snap is: volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[18f33ca4-5a7d-439b-b126-484516171a4b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:23 devstack sudo[93808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 Sep 18 00:38:23 devstack sudo[93808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:23 devstack sudo[93808]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968" returned: 0 in 0.615s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[31330935-3756-4371-be82-16baee4aaaa3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:24 devstack sudo[94150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd Sep 18 00:38:24 devstack sudo[94150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:24 devstack sudo[94150]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" returned: 0 in 0.873s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:24 devstack sudo[94177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 Sep 18 00:38:24 devstack sudo[94177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-00e50743-f5fe-4a29-a2b8-c28dab5af032 tempest-VolumesTransfersTest-1033842655 None] Transfer volume completed successfully. Sep 18 00:38:25 devstack sudo[94177]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968" returned: 0 in 0.584s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:25 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968 Sep 18 00:38:25 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:25 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd.057e7cd8-1073-471e-8cd8-42e65deb7968" returned: 0 in 0.379s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-057e7cd8-1073-471e-8cd8-42e65deb7968" released by "_delete_snapshot" :: held 2.718s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" released by "delete_snapshot" :: held 2.745s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['7cbdb5e6-1ae0-4ab2-ae3c-9111b39323d6', '0ae1a4e3-f13d-4ca6-acf1-adc3addb2f1c', '6de61cab-7d15-4838-a6a5-7fb5dbecae8f', '5576774b-d144-4ad0-9647-a7d4d63ef349'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Acquiring lock "cinder-26f97142-359f-42bf-9ea0-3907f023d4eb-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-26f97142-359f-42bf-9ea0-3907f023d4eb-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Delete snapshot completed successfully. Sep 18 00:38:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2b64d062-fe5b-489a-b2f3-07223e43900d tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-057e7cd8-1073-471e-8cd8-42e65deb7968-delete_snapshot" released by "delete_snapshot" :: held 2.952s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Acquiring lock "cinder-quobyte-26f97142-359f-42bf-9ea0-3907f023d4eb" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-quobyte-26f97142-359f-42bf-9ea0-3907f023d4eb" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[76afe2ff-cdf6-4c9d-83da-beed54890610]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:26 devstack sudo[94195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb Sep 18 00:38:26 devstack sudo[94195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-54be513c-f7d1-40a9-90f8-4aefaba6e2fd-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-54be513c-f7d1-40a9-90f8-4aefaba6e2fd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:26 devstack sudo[94195]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb" returned: 0 in 0.476s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3504e9b4-eed4-419e-899e-4a4a8b229698]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:26 devstack sudo[94200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb Sep 18 00:38:26 devstack sudo[94200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:26 devstack sudo[94201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd Sep 18 00:38:26 devstack sudo[94201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:26 devstack sudo[94200]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-26f97142-359f-42bf-9ea0-3907f023d4eb" returned: 0 in 0.302s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-quobyte-26f97142-359f-42bf-9ea0-3907f023d4eb" released by "delete_volume" :: held 0.824s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:26 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Created reservations ['9b19b3ef-9d65-4280-89d6-e3974128a47b', '384fa435-e73d-402e-abcf-a041e8ac7fc3', 'de3d893e-5b1e-4608-99c1-773014c248b8', 'f6f52411-03d7-44f6-97f7-e1e51aea0ebb'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:27 devstack sudo[94201]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:27 devstack sudo[94209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" returned: 0 in 0.534s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:27 devstack sudo[94209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:27 devstack sudo[94211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd Sep 18 00:38:27 devstack sudo[94211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:27 devstack sudo[94209]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Deleted volume successfully. Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-03077a90-da55-47e5-924d-1d971c317711 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-26f97142-359f-42bf-9ea0-3907f023d4eb-delete_volume" released by "delete_volume" :: held 1.455s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:27 devstack sudo[94211]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-54be513c-f7d1-40a9-90f8-4aefaba6e2fd" released by "delete_volume" :: held 1.023s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['67a0b35d-5994-4696-bf32-2a7a587ef151', 'd7c2f62a-95c4-480d-8b84-92e96e6431e9', '0d9cde2f-617d-4214-876a-be86c5c7226d', '7ed451c6-41d3-48fa-8016-703d6e72a19c'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:27 devstack sudo[94215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:27 devstack sudo[94215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Flow 'volume_create_manager' (e58e09ab-90f5-48f0-903f-98fd05b36d04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecdcf3a-edc0-4b67-aeb9-2a878c7bfb7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack sudo[94215]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.349s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ecdcf3a-edc0-4b67-aeb9-2a878c7bfb7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1119949126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a03a486-4465-4c53-85d9-1460685a7c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67c1ddde11142fd81195e867093a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:28Z,use_quota=True,user_id='b2f0c98cc77c4a3497a35c51397a0978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8b0745-c121-4bb4-b007-ce93ca7f70aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a8b0745-c121-4bb4-b007-ce93ca7f70aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc584985-1527-4e43-aaf4-543b1928e77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc584985-1527-4e43-aaf4-543b1928e77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a03a486-4465-4c53-85d9-1460685a7c74', 'volume_name': 'volume-0a03a486-4465-4c53-85d9-1460685a7c74', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd51a916-d4ac-42d9-8391-467f89ab315a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd51a916-d4ac-42d9-8391-467f89ab315a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e7e38f-fc91-4b7a-afd5-10bf464a5002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Volume 0a03a486-4465-4c53-85d9-1460685a7c74: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a03a486-4465-4c53-85d9-1460685a7c74', 'volume_size': 1} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1119949126',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a03a486-4465-4c53-85d9-1460685a7c74,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a67c1ddde11142fd81195e867093a770',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:28Z,use_quota=True,user_id='b2f0c98cc77c4a3497a35c51397a0978',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Creating volume 0a03a486-4465-4c53-85d9-1460685a7c74 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:28 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Deleted volume successfully. Sep 18 00:38:28 devstack sudo[94254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 1073741824 Sep 18 00:38:28 devstack sudo[94254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Flow 'volume_create_manager' (3267bd69-4ed1-4ef6-8fc9-18a096c1a5d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89271109-8029-4be3-885f-4548c277ede1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (89271109-8029-4be3-885f-4548c277ede1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1740335355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d5d6eb-3490-49e1-8d96-ab7b8787a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fde917266648e2bc63c3d91269d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:28Z,use_quota=True,user_id='0bc8824bc1654a45bfa1efe73c26c136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc17e04-df96-4011-88ee-51ac7baab458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cc17e04-df96-4011-88ee-51ac7baab458) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87670d7-40fb-468a-9844-8adc9fa64604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f87670d7-40fb-468a-9844-8adc9fa64604) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3d5d6eb-3490-49e1-8d96-ab7b8787a02c', 'volume_name': 'volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7fe8b3-2393-4e05-b905-96e937570960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fc7fe8b3-2393-4e05-b905-96e937570960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c1e500-924a-4ded-b37c-265097fa18c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:28 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Volume a3d5d6eb-3490-49e1-8d96-ab7b8787a02c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c', 'volume_size': 1} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-77e29daf-00b2-48a6-a086-d5e57a14f25c tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-54be513c-f7d1-40a9-90f8-4aefaba6e2fd-delete_volume" released by "delete_volume" :: held 2.032s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:28 devstack sudo[94254]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 1073741824" returned: 0 in 0.721s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:29 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 Sep 18 00:38:29 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:29 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74" returned: 0 in 0.445s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.248s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.044s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1740335355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3d5d6eb-3490-49e1-8d96-ab7b8787a02c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fde917266648e2bc63c3d91269d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:28Z,use_quota=True,user_id='0bc8824bc1654a45bfa1efe73c26c136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Creating volume a3d5d6eb-3490-49e1-8d96-ab7b8787a02c {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:29 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:29 devstack sudo[94377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c 1073741824 Sep 18 00:38:29 devstack sudo[94377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5e7e38f-fc91-4b7a-afd5-10bf464a5002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a03a486-4465-4c53-85d9-1460685a7c74', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54832fc-ae9f-413f-98f8-202da4f29faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:29 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Volume volume-0a03a486-4465-4c53-85d9-1460685a7c74 (0a03a486-4465-4c53-85d9-1460685a7c74): created successfully Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d54832fc-ae9f-413f-98f8-202da4f29faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Flow 'volume_create_manager' (e58e09ab-90f5-48f0-903f-98fd05b36d04) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9aa6889a-940d-4c81-9ed2-88edcab67487 tempest-VolumesTransfersTest-122704499 None] Created volume successfully. Sep 18 00:38:29 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (a1adc4f7-f235-477b-9fef-e8def7370b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c99857-4da9-4185-80f3-584a2ce5ff54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f6c99857-4da9-4185-80f3-584a2ce5ff54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1395678061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc78d2e9-a84c-4620-83c0-0725361f6a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:30Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e1de5-2930-4959-8015-f75f8074f56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (044e1de5-2930-4959-8015-f75f8074f56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e963b6-1b60-424a-b224-f0129b8ea5cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46e963b6-1b60-424a-b224-f0129b8ea5cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc78d2e9-a84c-4620-83c0-0725361f6a43', 'volume_name': 'volume-fc78d2e9-a84c-4620-83c0-0725361f6a43', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3753f229-22bd-4bd1-9154-7206149aa57b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3753f229-22bd-4bd1-9154-7206149aa57b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c9c85f-43d6-4891-8c62-6365eb9e32ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:30 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Volume fc78d2e9-a84c-4620-83c0-0725361f6a43: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc78d2e9-a84c-4620-83c0-0725361f6a43', 'volume_size': 1} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:30 devstack sudo[94377]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c 1073741824" returned: 0 in 1.068s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:30 devstack sudo[94754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c Sep 18 00:38:30 devstack sudo[94754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Acquiring lock "cinder-0a03a486-4465-4c53-85d9-1460685a7c74-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-0a03a486-4465-4c53-85d9-1460685a7c74-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Acquiring lock "cinder-quobyte-0a03a486-4465-4c53-85d9-1460685a7c74" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-quobyte-0a03a486-4465-4c53-85d9-1460685a7c74" acquired by "delete_volume" :: waited 0.042s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfc8095a-5182-4151-9394-d2a2ad60ee8d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:31 devstack sudo[94754]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c" returned: 0 in 0.629s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] <== create_volume: return (1798ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.805s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.101s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1395678061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc78d2e9-a84c-4620-83c0-0725361f6a43,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:30Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Creating volume fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:31 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3c1e500-924a-4ded-b37c-265097fa18c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67419e5-844e-446b-a118-94a421714fc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:31 devstack sudo[94771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 1073741824 Sep 18 00:38:31 devstack sudo[94771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:31 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Volume volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c (a3d5d6eb-3490-49e1-8d96-ab7b8787a02c): created successfully Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c67419e5-844e-446b-a118-94a421714fc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Flow 'volume_create_manager' (3267bd69-4ed1-4ef6-8fc9-18a096c1a5d1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c7d4aab-d1b4-4bf3-9206-31ff0a85d4b5 tempest-ServersNegativeTestJSON-2040073493 None] Created volume successfully. Sep 18 00:38:31 devstack sudo[94768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 Sep 18 00:38:31 devstack sudo[94768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:31 devstack sudo[94768]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74" returned: 0 in 0.474s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:31 devstack sudo[94782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74 Sep 18 00:38:31 devstack sudo[94782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:31 devstack sudo[94771]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 1073741824" returned: 0 in 0.602s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:31 devstack sudo[94785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 Sep 18 00:38:31 devstack sudo[94785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:32 devstack sudo[94782]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a03a486-4465-4c53-85d9-1460685a7c74" returned: 0 in 0.355s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-quobyte-0a03a486-4465-4c53-85d9-1460685a7c74" released by "delete_volume" :: held 0.966s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Created reservations ['85ab2494-dc53-4dc9-83fb-834327121a19', '8aca67a6-a861-4e01-9c36-d9bdfa141391', '02406d5b-b4e8-4006-a47a-259194201492', 'a15cc5d3-779f-44b4-bfd8-49755f781556'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:32 devstack sudo[94791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:32 devstack sudo[94791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:32 devstack sudo[94785]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43" returned: 0 in 0.452s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] <== create_volume: return (1102ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.110s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29c9c85f-43d6-4891-8c62-6365eb9e32ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc78d2e9-a84c-4620-83c0-0725361f6a43', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaa15ce-50a6-4f8c-84bf-fc8170386c93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Volume volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 (fc78d2e9-a84c-4620-83c0-0725361f6a43): created successfully Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (deaa15ce-50a6-4f8c-84bf-fc8170386c93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (a1adc4f7-f235-477b-9fef-e8def7370b19) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1a431a02-ad37-43d8-90a8-ee4592ae0de2 tempest-VolumesSnapshotTestJSON-2117124607 None] Created volume successfully. Sep 18 00:38:32 devstack sudo[94791]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.404s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Deleted volume successfully. Sep 18 00:38:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f44f79e8-f94f-4d24-b46e-414f6594b079 tempest-VolumesTransfersTest-1333876465 None] Lock "cinder-0a03a486-4465-4c53-85d9-1460685a7c74-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Creating offline snapshot 8cecbe7a-d366-4c47-9b84-e5973efaf629 of volume fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:38:33 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fd3eabf-ac8d-44ef-b88c-08ce342ed51c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:33 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 Sep 18 00:38:33 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:33 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43" returned: 0 in 0.447s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:33 devstack sudo[94799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 1G Sep 18 00:38:33 devstack sudo[94799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:34 devstack sudo[94799]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Flow 'volume_create_manager' (6cc88f9c-3a97-4a1c-bec0-8c61d4e38d73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2418c74b-e829-4140-a689-fda5cf17fd63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 1G" returned: 0 in 0.724s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2418c74b-e829-4140-a689-fda5cf17fd63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-927639053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d245de3a-ddc1-4b28-b132-c02636fbae6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fde917266648e2bc63c3d91269d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:34Z,use_quota=True,user_id='0bc8824bc1654a45bfa1efe73c26c136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eee67cc-6515-47af-84ee-c04c11779736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7eee67cc-6515-47af-84ee-c04c11779736) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:34 devstack sudo[94805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 Sep 18 00:38:34 devstack sudo[94805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d26bee2-32d6-44b4-816d-6efbb5ae0b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d26bee2-32d6-44b4-816d-6efbb5ae0b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd245de3a-ddc1-4b28-b132-c02636fbae6b', 'volume_name': 'volume-d245de3a-ddc1-4b28-b132-c02636fbae6b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a00668f-749f-406a-8f3d-b5fab25460c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a00668f-749f-406a-8f3d-b5fab25460c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122f89c8-0ee1-4dc4-bfbc-fcbdb2717b55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Volume d245de3a-ddc1-4b28-b132-c02636fbae6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d245de3a-ddc1-4b28-b132-c02636fbae6b', 'volume_size': 1} Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:34 devstack sudo[94805]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:34 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 is being set with open permissions: ugo+rw Sep 18 00:38:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:35 devstack sudo[94810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 Sep 18 00:38:35 devstack sudo[94810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:35 devstack sudo[94810]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:35 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.info Sep 18 00:38:35 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:35 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.info" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:35 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.info is being set with open permissions: ugo+rw Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:35 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.info Sep 18 00:38:35 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:35 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.info" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.218s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-927639053',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d245de3a-ddc1-4b28-b132-c02636fbae6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0fde917266648e2bc63c3d91269d16f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:34Z,use_quota=True,user_id='0bc8824bc1654a45bfa1efe73c26c136',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Creating volume d245de3a-ddc1-4b28-b132-c02636fbae6b {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:35 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:35 devstack sudo[94819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b 1073741824 Sep 18 00:38:35 devstack sudo[94819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3d33ccca-40ec-4381-9be7-05031d1ce2cd tempest-VolumesSnapshotTestJSON-2117124607 None] Create snapshot completed successfully Sep 18 00:38:36 devstack sudo[94819]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b 1073741824" returned: 0 in 0.513s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:36 devstack sudo[94826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b Sep 18 00:38:36 devstack sudo[94826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:36 devstack sudo[94826]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b" returned: 0 in 0.354s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.935s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (122f89c8-0ee1-4dc4-bfbc-fcbdb2717b55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d245de3a-ddc1-4b28-b132-c02636fbae6b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18f43f3-7264-4f52-a348-d6bedead7921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:36 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Volume volume-d245de3a-ddc1-4b28-b132-c02636fbae6b (d245de3a-ddc1-4b28-b132-c02636fbae6b): created successfully Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f18f43f3-7264-4f52-a348-d6bedead7921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Flow 'volume_create_manager' (6cc88f9c-3a97-4a1c-bec0-8c61d4e38d73) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ddaf6de6-1106-4392-b5ab-0cb467645498 tempest-ServersNegativeTestJSON-2040073493 None] Created volume successfully. Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (67d58ce7-d17e-4c7d-846d-bfe2ce91c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10370902-9b8c-481d-9c2e-2a66fbb45a16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10370902-9b8c-481d-9c2e-2a66fbb45a16) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1867360217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3dff925-51e7-436d-ae52-7e864a37512f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7362bc5e2cf3467ab4049248f1d5311c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8cecbe7a-d366-4c47-9b84-e5973efaf629,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:37Z,use_quota=True,user_id='07b3a6f16c404fe7a23ec5a0b4d6930f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9636cd-37b7-4e1b-9001-34fb13dfc88e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5f9636cd-37b7-4e1b-9001-34fb13dfc88e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13a5264-5ff6-4d78-9140-d0052a75964b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a13a5264-5ff6-4d78-9140-d0052a75964b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b3dff925-51e7-436d-ae52-7e864a37512f', 'volume_name': 'volume-b3dff925-51e7-436d-ae52-7e864a37512f', 'volume_size': 1, 'snapshot_id': '8cecbe7a-d366-4c47-9b84-e5973efaf629'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ba3d83-20e0-4f10-9dca-b02faf525c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85ba3d83-20e0-4f10-9dca-b02faf525c92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9e32e7-6440-4b3f-af67-5cb53cf42aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Volume b3dff925-51e7-436d-ae52-7e864a37512f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b3dff925-51e7-436d-ae52-7e864a37512f', 'volume_size': 1, 'snapshot_id': '8cecbe7a-d366-4c47-9b84-e5973efaf629'} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-8cecbe7a-d366-4c47-9b84-e5973efaf629-b3dff925-51e7-436d-ae52-7e864a37512f" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-8cecbe7a-d366-4c47-9b84-e5973efaf629-b3dff925-51e7-436d-ae52-7e864a37512f" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Creating volume b3dff925-51e7-436d-ae52-7e864a37512f from snapshot 8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-b3dff925-51e7-436d-ae52-7e864a37512f" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-b3dff925-51e7-436d-ae52-7e864a37512f" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] snapshot: 8cecbe7a-d366-4c47-9b84-e5973efaf629, volume: b3dff925-51e7-436d-ae52-7e864a37512f, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fe2e2cbc-1a7e-4e0b-b23c-2cbc31781bde]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:37 devstack sudo[94829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 Sep 18 00:38:37 devstack sudo[94829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:38 devstack sudo[94829]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629" returned: 0 in 0.672s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc78d2e9-a84c-4620-83c0-0725361f6a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[148a1beb-16ff-491e-9af7-636c93f7e78a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "cinder-d245de3a-ddc1-4b28-b132-c02636fbae6b-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-d245de3a-ddc1-4b28-b132-c02636fbae6b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:38 devstack sudo[94835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 Sep 18 00:38:38 devstack sudo[94835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "cinder-quobyte-d245de3a-ddc1-4b28-b132-c02636fbae6b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-quobyte-d245de3a-ddc1-4b28-b132-c02636fbae6b" acquired by "delete_volume" :: waited 0.041s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc72137b-6ec8-439c-92e7-baedd9171c4c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:38 devstack sudo[94837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b Sep 18 00:38:38 devstack sudo[94837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:38 devstack sudo[94835]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43" returned: 0 in 0.506s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:38 devstack sudo[94845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f Sep 18 00:38:38 devstack sudo[94845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:38 devstack sudo[94837]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b" returned: 0 in 0.458s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:38 devstack sudo[94850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b Sep 18 00:38:38 devstack sudo[94850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:39 devstack sudo[94850]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d245de3a-ddc1-4b28-b132-c02636fbae6b" returned: 0 in 0.362s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-quobyte-d245de3a-ddc1-4b28-b132-c02636fbae6b" released by "delete_volume" :: held 0.896s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Created reservations ['c0bbbabf-9498-4e25-bc79-493faec06f31', '3180c0ee-1050-4a72-8a50-fee1141733b2', '9e5f9961-908a-4452-ada9-cccd4afb21f2', 'd29af53c-1b37-42ea-8a95-f86b40a5ec92'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:39 devstack sudo[94863]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:39 devstack sudo[94863]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:40 devstack sudo[94863]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.742s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:40 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Deleted volume successfully. Sep 18 00:38:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6586e6d2-ab07-475d-8bcb-73cf64e9dd6e tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-d245de3a-ddc1-4b28-b132-c02636fbae6b-delete_volume" released by "delete_volume" :: held 2.251s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "cinder-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "cinder-quobyte-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-quobyte-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:41 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed5a801a-675a-4f0a-be1f-a7bafd11c27b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:41 devstack sudo[94867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c Sep 18 00:38:41 devstack sudo[94867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:42 devstack sudo[94867]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c" returned: 0 in 1.024s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:42 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c Sep 18 00:38:42 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:42 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c" returned: 0 in 0.536s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-quobyte-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c" released by "delete_volume" :: held 1.665s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:42 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Created reservations ['5d20fc16-9008-426b-b394-a81632f0571f', 'ab5b44b1-2771-4d8d-9e92-32519dfb0555', '197a9654-7f66-4823-a20f-12e6ed4f90c9', '341f709a-401a-47a8-a53f-e82e7b4ef028'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:43 devstack sudo[94875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:43 devstack sudo[94875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:43 devstack sudo[94875]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.486s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Deleted volume successfully. Sep 18 00:38:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d7c558ab-1b4a-44d8-8ff5-8de4e1d9bea0 tempest-ServersNegativeTestJSON-2040073493 None] Lock "cinder-a3d5d6eb-3490-49e1-8d96-ab7b8787a02c-delete_volume" released by "delete_volume" :: held 2.734s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Flow 'volume_create_manager' (aac018f2-2334-47b6-87a3-d96a4bb23917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa33f4d1-991f-4659-82fb-06aa5c320e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa33f4d1-991f-4659-82fb-06aa5c320e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-841139734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb74df08-760c-49e6-91a6-7b7908f98a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5767f2e5689487995955d591b89dbe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:47Z,use_quota=True,user_id='d3951aeaa2ba48488c4eb31541cc88ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ccb876-dbb5-45d1-97fd-b23013b1dad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71ccb876-dbb5-45d1-97fd-b23013b1dad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913c973b-71a2-4364-ad96-f1cb64a7c6b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (913c973b-71a2-4364-ad96-f1cb64a7c6b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bb74df08-760c-49e6-91a6-7b7908f98a21', 'volume_name': 'volume-bb74df08-760c-49e6-91a6-7b7908f98a21', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60377a12-8e19-4788-a379-78cd274f0f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (60377a12-8e19-4788-a379-78cd274f0f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c5c704-eda7-4531-a932-2402115621a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:47 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Volume bb74df08-760c-49e6-91a6-7b7908f98a21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bb74df08-760c-49e6-91a6-7b7908f98a21', 'volume_size': 1} Sep 18 00:38:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:48 devstack sudo[94845]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f" returned: 0 in 10.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:48 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43, size 1024.00 MB, duration 10.28 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:38:48 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Converted 1024.00 MB image at 99.56 MB/s Sep 18 00:38:48 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f is being set with open permissions: ugo+rw Sep 18 00:38:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:49 devstack sudo[94946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f Sep 18 00:38:49 devstack sudo[94946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:49 devstack sudo[94946]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-b3dff925-51e7-436d-ae52-7e864a37512f" released by "_copy_volume_from_snapshot" :: held 11.846s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-8cecbe7a-d366-4c47-9b84-e5973efaf629-b3dff925-51e7-436d-ae52-7e864a37512f" released by "_create_volume_from_snapshot" :: held 11.922s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.940s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.859s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-841139734',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bb74df08-760c-49e6-91a6-7b7908f98a21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5767f2e5689487995955d591b89dbe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:47Z,use_quota=True,user_id='d3951aeaa2ba48488c4eb31541cc88ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Creating volume bb74df08-760c-49e6-91a6-7b7908f98a21 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:49 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:49 devstack sudo[94949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 1073741824 Sep 18 00:38:49 devstack sudo[94949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc9e32e7-6440-4b3f-af67-5cb53cf42aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3dff925-51e7-436d-ae52-7e864a37512f', 'volume_size': 1, 'snapshot_id': '8cecbe7a-d366-4c47-9b84-e5973efaf629'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceaebb7-6b37-4f4a-b780-aeb0f018e6c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:49 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Volume volume-b3dff925-51e7-436d-ae52-7e864a37512f (b3dff925-51e7-436d-ae52-7e864a37512f): created successfully Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7ceaebb7-6b37-4f4a-b780-aeb0f018e6c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Flow 'volume_create_manager' (67d58ce7-d17e-4c7d-846d-bfe2ce91c57d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5dc2fc16-eecf-4d11-93ef-bb1831bbe1e6 tempest-VolumesSnapshotTestJSON-2117124607 None] Created volume successfully. Sep 18 00:38:49 devstack sudo[94949]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 1073741824" returned: 0 in 0.450s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:49 devstack sudo[94955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 Sep 18 00:38:49 devstack sudo[94955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-b3dff925-51e7-436d-ae52-7e864a37512f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-b3dff925-51e7-436d-ae52-7e864a37512f-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:50 devstack sudo[94955]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3c5c704-eda7-4531-a932-2402115621a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bb74df08-760c-49e6-91a6-7b7908f98a21', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e5d14c-fb2e-493d-b65a-aba2f7a72038) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-b3dff925-51e7-436d-ae52-7e864a37512f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:50 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Volume volume-bb74df08-760c-49e6-91a6-7b7908f98a21 (bb74df08-760c-49e6-91a6-7b7908f98a21): created successfully Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32e5d14c-fb2e-493d-b65a-aba2f7a72038) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Flow 'volume_create_manager' (aac018f2-2334-47b6-87a3-d96a4bb23917) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-b3dff925-51e7-436d-ae52-7e864a37512f" acquired by "delete_volume" :: waited 0.033s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-01d94424-42a0-48fa-a135-48ec67ecff47 tempest-VolumesTransfersV357Test-91529124 None] Created volume successfully. Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[43e7dbea-57ab-40b6-a9ec-f3238168e50a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:50 devstack sudo[94958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f Sep 18 00:38:50 devstack sudo[94958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:50 devstack sudo[94958]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f" returned: 0 in 0.396s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:50 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f Sep 18 00:38:50 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:50 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b3dff925-51e7-436d-ae52-7e864a37512f" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-b3dff925-51e7-436d-ae52-7e864a37512f" released by "delete_volume" :: held 0.777s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['17506150-f5b1-4aec-96b2-91f95aeef1b1', 'f78dfc88-7861-41f5-ac88-a29ea9e78778', '968de186-f523-44af-a263-714b0f4770fb', '1cd677b4-d0c4-4971-80d9-9d9726917d06'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1e879684-c3ae-4112-9a67-b6f5a9755177 tempest-VolumesTransfersV357Test-683413891 None] Transfer volume completed successfully. Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:51 devstack sudo[94969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:51 devstack sudo[94969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-8cecbe7a-d366-4c47-9b84-e5973efaf629-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-8cecbe7a-d366-4c47-9b84-e5973efaf629-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-fc78d2e9-a84c-4620-83c0-0725361f6a43" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-fc78d2e9-a84c-4620-83c0-0725361f6a43" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-8cecbe7a-d366-4c47-9b84-e5973efaf629" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-8cecbe7a-d366-4c47-9b84-e5973efaf629" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Deleting offline snapshot 8cecbe7a-d366-4c47-9b84-e5973efaf629 of volume fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] snapshot_file for this snap is: volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:38:51 devstack sudo[94969]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[027f2ed1-5457-4254-a137-e64c3d3ccd71]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.374s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Deleted volume successfully. Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c82fb4b8-9f21-47d3-b84b-3fca0bfb1929 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-b3dff925-51e7-436d-ae52-7e864a37512f-delete_volume" released by "delete_volume" :: held 1.459s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:51 devstack sudo[94972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 Sep 18 00:38:51 devstack sudo[94972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Acquiring lock "cinder-bb74df08-760c-49e6-91a6-7b7908f98a21-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-bb74df08-760c-49e6-91a6-7b7908f98a21-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Acquiring lock "cinder-quobyte-bb74df08-760c-49e6-91a6-7b7908f98a21" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-quobyte-bb74df08-760c-49e6-91a6-7b7908f98a21" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[aefbe139-9652-4fb1-99e2-ad4583fad404]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:51 devstack sudo[94972]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629" returned: 0 in 0.517s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc78d2e9-a84c-4620-83c0-0725361f6a43(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea2a11f2-cbe1-49e9-ad48-1cc59d4b566b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:52 devstack sudo[94978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 Sep 18 00:38:52 devstack sudo[94978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:52 devstack sudo[94979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 Sep 18 00:38:52 devstack sudo[94979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:52 devstack sudo[94978]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21" returned: 0 in 0.504s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:52 devstack sudo[94987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21 Sep 18 00:38:52 devstack sudo[94987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:52 devstack sudo[94979]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43" returned: 0 in 0.654s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:52 devstack sudo[94990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 Sep 18 00:38:52 devstack sudo[94990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:52 devstack sudo[94987]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bb74df08-760c-49e6-91a6-7b7908f98a21" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-quobyte-bb74df08-760c-49e6-91a6-7b7908f98a21" released by "delete_volume" :: held 0.868s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Created reservations ['3ddc8144-764a-423e-b061-f6933983f286', '7dc8342b-4e55-41cc-be80-a00d078b3b1a', '7605b7c8-29f6-4e33-a379-e4fb7dce390c', 'e79bf04a-2aa4-41d6-a35b-3e39c4a73037'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:53 devstack sudo[94998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:53 devstack sudo[94998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:53 devstack sudo[94990]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629" returned: 0 in 0.525s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:53 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629 Sep 18 00:38:53 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:53 devstack sudo[94998]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.453s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Deleted volume successfully. Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-baa9f7e7-c751-4ab1-bbf5-de2ca41af56a tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-bb74df08-760c-49e6-91a6-7b7908f98a21-delete_volume" released by "delete_volume" :: held 1.667s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:53 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43.8cecbe7a-d366-4c47-9b84-e5973efaf629" returned: 0 in 0.520s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-8cecbe7a-d366-4c47-9b84-e5973efaf629" released by "_delete_snapshot" :: held 2.359s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-fc78d2e9-a84c-4620-83c0-0725361f6a43" released by "delete_snapshot" :: held 2.387s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['2063782b-8103-4676-990b-4cec18945351', '5411f835-1b93-43ca-9c62-2a7229de8e59', '5e54db8c-b97e-43ea-8209-36d0b9a1dc07', 'f2c8f0f6-2f7a-4599-a764-8964f03926c5'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Delete snapshot completed successfully. Sep 18 00:38:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-83faf142-d9b0-4b0a-b9f3-541c174c3670 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-8cecbe7a-d366-4c47-9b84-e5973efaf629-delete_snapshot" released by "delete_snapshot" :: held 2.622s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:54 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b118449f-4885-4094-824e-6464b102422e req-81051085-1695-45ba-a351-bee7d23bdac3 tempest-AttachVolumeTestJSON-1494072351 None] Terminate volume connection completed successfully. Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-b118449f-4885-4094-824e-6464b102422e req-81051085-1695-45ba-a351-bee7d23bdac3 tempest-AttachVolumeTestJSON-1494072351 None] Deleting attachment afb24f1e-7142-4990-892d-b1dcbb8959e3. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Flow 'volume_create_manager' (efcc428a-56d8-43da-b595-abbd0329a2d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52de33c8-0551-4e19-a806-8e87d5a716e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52de33c8-0551-4e19-a806-8e87d5a716e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1050826746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5767f2e5689487995955d591b89dbe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:54Z,use_quota=True,user_id='d3951aeaa2ba48488c4eb31541cc88ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f34359c-b8bd-49d2-8e29-949a9e459d0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f34359c-b8bd-49d2-8e29-949a9e459d0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991f8f37-bcea-48e4-80fa-0033ed4e5e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (991f8f37-bcea-48e4-80fa-0033ed4e5e9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2', 'volume_name': 'volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b1e58-e0b9-45b1-899d-5f556bcf24bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (346b1e58-e0b9-45b1-899d-5f556bcf24bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2ab5b1-eee1-4e9f-8a08-0405e713a811) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:54 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Volume 56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2', 'volume_size': 1} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:38:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1050826746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5767f2e5689487995955d591b89dbe2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:38:54Z,use_quota=True,user_id='d3951aeaa2ba48488c4eb31541cc88ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Creating volume 56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:38:54 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:54 devstack sudo[95009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 1073741824 Sep 18 00:38:54 devstack sudo[95009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-fc78d2e9-a84c-4620-83c0-0725361f6a43-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-fc78d2e9-a84c-4620-83c0-0725361f6a43-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-fc78d2e9-a84c-4620-83c0-0725361f6a43" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-fc78d2e9-a84c-4620-83c0-0725361f6a43" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:54 devstack sudo[95009]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 1073741824" returned: 0 in 0.707s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4adc52-dae7-4030-85c4-f37f0671e872]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:55 devstack sudo[95018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 Sep 18 00:38:55 devstack sudo[95018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:55 devstack sudo[95017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 Sep 18 00:38:55 devstack sudo[95017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:55 devstack sudo[95018]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2" returned: 0 in 0.360s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] <== create_volume: return (1134ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.136s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2ab5b1-eee1-4e9f-8a08-0405e713a811) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0ae863-0e95-4595-9823-29c3cafe30c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:38:55 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Volume volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 (56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2): created successfully Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ec0ae863-0e95-4595-9823-29c3cafe30c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Flow 'volume_create_manager' (efcc428a-56d8-43da-b595-abbd0329a2d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:38:55 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3635cce5-20ac-4749-b798-d79d9ba510cd tempest-VolumesTransfersV357Test-91529124 None] Created volume successfully. Sep 18 00:38:55 devstack sudo[95017]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43" returned: 0 in 0.520s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:55 devstack sudo[95029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43 Sep 18 00:38:55 devstack sudo[95029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:55 devstack sudo[95029]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fc78d2e9-a84c-4620-83c0-0725361f6a43" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-fc78d2e9-a84c-4620-83c0-0725361f6a43" released by "delete_volume" :: held 0.934s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['2c8347c2-1ff0-465a-ac8f-73301c621267', '7ee50e09-2aee-43e3-a770-e66ec212e8d5', 'f3777717-15ac-4b29-a45d-adb67657117d', '2eb57790-142a-4135-99bf-551697c9b470'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:56 devstack sudo[95032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:56 devstack sudo[95032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-0f8f4abf-6c8a-4b56-991b-441a8e473d86-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-0f8f4abf-6c8a-4b56-991b-441a8e473d86-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "cinder-quobyte-0f8f4abf-6c8a-4b56-991b-441a8e473d86" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-0f8f4abf-6c8a-4b56-991b-441a8e473d86" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fa1ff0c-03a6-4568-bdf2-688bf044a777]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:56 devstack sudo[95032]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.406s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:56 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Deleted volume successfully. Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9423d2d7-c945-45e4-a9c6-db22214ba0f0 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-fc78d2e9-a84c-4620-83c0-0725361f6a43-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:56 devstack sudo[95035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 Sep 18 00:38:56 devstack sudo[95035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Acquiring lock "cinder-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Acquiring lock "cinder-quobyte-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-quobyte-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[85764a36-e77a-4a53-824d-480287988dfb]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:56 devstack sudo[95035]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86" returned: 0 in 0.542s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:56 devstack sudo[95041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86 Sep 18 00:38:56 devstack sudo[95041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:57 devstack sudo[95040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 Sep 18 00:38:57 devstack sudo[95040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:57 devstack sudo[95041]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0f8f4abf-6c8a-4b56-991b-441a8e473d86" returned: 0 in 0.335s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-quobyte-0f8f4abf-6c8a-4b56-991b-441a8e473d86" released by "delete_volume" :: held 1.005s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Created reservations ['62c3538c-d510-4029-b5f8-b0ca5c0741b9', 'b7403791-ec86-48a4-a367-836b532c84cb', 'e991a0bb-23a1-4c01-a6b1-9824287799ea', '54f7e123-92a4-47ff-bc0c-5c6a2f6f6c9a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:57 devstack sudo[95040]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2" returned: 0 in 0.580s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:57 devstack sudo[95057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2 Sep 18 00:38:57 devstack sudo[95057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:57 devstack sudo[95065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:57 devstack sudo[95065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:57 devstack sudo[95065]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.447s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:57 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Deleted volume successfully. Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d13bed28-2dae-4c36-a072-caed0eb03163 tempest-VolumesSnapshotTestJSON-2117124607 None] Lock "cinder-0f8f4abf-6c8a-4b56-991b-441a8e473d86-delete_volume" released by "delete_volume" :: held 1.805s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:57 devstack sudo[95057]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2" returned: 0 in 0.540s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-quobyte-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2" released by "delete_volume" :: held 1.194s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Created reservations ['c007a042-2633-4a5d-85a8-708139db210b', 'f54fd915-4f3e-4014-92c2-346cba7afbc6', '09f8b24c-66ee-42fe-958d-e3294d8f49b6', '7cd98993-5f16-4dc3-b334-54827da4eb0e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:38:58 devstack sudo[95104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:38:58 devstack sudo[95104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:38:58 devstack sudo[95104]: pam_unix(sudo:session): session closed for user root Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.414s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:38:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Deleted volume successfully. Sep 18 00:38:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f882cdff-57f3-4d3b-a1c1-ee977deea862 tempest-VolumesTransfersV357Test-281551157 None] Lock "cinder-56c47cc1-c3c5-4944-89d0-8d40c2e6a8d2-delete_volume" released by "delete_volume" :: held 2.037s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:04 devstack sudo[95195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:39:04 devstack sudo[95195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:04 devstack sudo[95195]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.357s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:39:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:39:08 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=103,cinder:UPDATE=131,cinder:DELETE=15,cinder:INSERT=32 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:39:08 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=95,cinder:UPDATE=132,cinder:INSERT=31,cinder:DELETE=7 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Flow 'volume_create_manager' (032c81be-e946-41f8-9707-21d6175cc1cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f971ff5-35fd-408f-9d49-4123688f66b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2f971ff5-35fd-408f-9d49-4123688f66b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1551720203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b150fd7-1582-4da5-b409-d300ddc0811b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86acc63b5f64fafa6ac94918c1f21c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:39:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:39:12Z,use_quota=True,user_id='c6a59a0a662142e2b90b702cc57d8293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f018d1d-3e0e-498b-9135-fff81b37dba9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f018d1d-3e0e-498b-9135-fff81b37dba9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1bd778-aa70-4f87-884d-364bf26824dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca1bd778-aa70-4f87-884d-364bf26824dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b150fd7-1582-4da5-b409-d300ddc0811b', 'volume_name': 'volume-7b150fd7-1582-4da5-b409-d300ddc0811b', 'volume_size': 2}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bb2a12-cce8-4653-a22b-72a8965d9ff6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2bb2a12-cce8-4653-a22b-72a8965d9ff6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8931a2fb-0784-4f7d-9848-13d5b74da165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:12 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Volume 7b150fd7-1582-4da5-b409-d300ddc0811b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b150fd7-1582-4da5-b409-d300ddc0811b', 'volume_size': 2} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:39:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1551720203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b150fd7-1582-4da5-b409-d300ddc0811b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f86acc63b5f64fafa6ac94918c1f21c7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:39:12Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:39:12Z,use_quota=True,user_id='c6a59a0a662142e2b90b702cc57d8293',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Creating volume 7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:39:12 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b 2147483648 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:12 devstack sudo[95202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b 2147483648 Sep 18 00:39:12 devstack sudo[95202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:12 devstack sudo[95202]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b 2147483648" returned: 0 in 0.752s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:12 devstack sudo[95214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b Sep 18 00:39:12 devstack sudo[95214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:13 devstack sudo[95214]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b" returned: 0 in 0.415s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] <== create_volume: return (1231ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:39:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8931a2fb-0784-4f7d-9848-13d5b74da165) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b150fd7-1582-4da5-b409-d300ddc0811b', 'volume_size': 2}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a1f431-efeb-49c4-b789-954e0a075b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:13 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Volume volume-7b150fd7-1582-4da5-b409-d300ddc0811b (7b150fd7-1582-4da5-b409-d300ddc0811b): created successfully Sep 18 00:39:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7a1f431-efeb-49c4-b789-954e0a075b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Flow 'volume_create_manager' (032c81be-e946-41f8-9707-21d6175cc1cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:39:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b5a56f5b-0950-4ab6-9622-028c723b17cd tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Created volume successfully. Sep 18 00:39:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Creating offline snapshot a218625d-9bf8-4a18-a318-32db5ff4725c of volume 7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:39:14 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1eddb76b-f6c1-4317-8608-3fef1be82a6b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:39:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:14 devstack sudo[95220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b Sep 18 00:39:14 devstack sudo[95220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:14 devstack sudo[95220]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b" returned: 0 in 0.416s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c 2G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:14 devstack sudo[95225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c 2G Sep 18 00:39:14 devstack sudo[95225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:15 devstack sudo[95225]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c 2G" returned: 0 in 0.465s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b150fd7-1582-4da5-b409-d300ddc0811b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:15 devstack sudo[95231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b150fd7-1582-4da5-b409-d300ddc0811b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c Sep 18 00:39:15 devstack sudo[95231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:15 devstack sudo[95231]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7b150fd7-1582-4da5-b409-d300ddc0811b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c" returned: 0 in 0.360s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:15 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c is being set with open permissions: ugo+rw Sep 18 00:39:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:15 devstack sudo[95236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c Sep 18 00:39:15 devstack sudo[95236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:15 devstack sudo[95236]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c" returned: 0 in 0.310s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:15 devstack sudo[95239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.info Sep 18 00:39:15 devstack sudo[95239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:16 devstack sudo[95239]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.info" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:16 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.info is being set with open permissions: ugo+rw Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:16 devstack sudo[95242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.info Sep 18 00:39:16 devstack sudo[95242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:16 devstack sudo[95242]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.info" returned: 0 in 0.288s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.229s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Flow 'volume_create_manager' (b8b3ef29-52d0-436e-9753-5c99495c0bcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763c8798-c76e-45b7-8bc8-5a9d0a7f59d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-129e355d-1ee5-4e45-84a5-aaf67b945310 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Create snapshot completed successfully Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (763c8798-c76e-45b7-8bc8-5a9d0a7f59d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1137520065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913ffd2c-fb2e-4a20-8358-91baec3b5c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4c48cb326b4470abf8f9b0d6c9563a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:39:16Z,use_quota=True,user_id='d29266ab7bb24308bb2c0120ca0279cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5947e63-7886-418e-afde-588213c1a852) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5947e63-7886-418e-afde-588213c1a852) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6e5966-e812-49fd-9985-94574da5cdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd6e5966-e812-49fd-9985-94574da5cdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '913ffd2c-fb2e-4a20-8358-91baec3b5c94', 'volume_name': 'volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74aa9ac-f034-4291-9d2a-307c037dd430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e74aa9ac-f034-4291-9d2a-307c037dd430) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed08732e-3ebe-4e02-9d1b-7b284a9b984f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Volume 913ffd2c-fb2e-4a20-8358-91baec3b5c94: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94', 'volume_size': 1} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1137520065',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=913ffd2c-fb2e-4a20-8358-91baec3b5c94,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='5b4c48cb326b4470abf8f9b0d6c9563a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:39:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:39:16Z,use_quota=True,user_id='d29266ab7bb24308bb2c0120ca0279cb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Creating volume 913ffd2c-fb2e-4a20-8358-91baec3b5c94 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:39:16 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:39:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:16 devstack sudo[95245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 1073741824 Sep 18 00:39:16 devstack sudo[95245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:17 devstack sudo[95245]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 1073741824" returned: 0 in 0.461s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:17 devstack sudo[95251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 Sep 18 00:39:17 devstack sudo[95251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:17 devstack sudo[95251]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed08732e-3ebe-4e02-9d1b-7b284a9b984f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823d3890-31b9-440c-8d01-89c072b12e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Volume volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 (913ffd2c-fb2e-4a20-8358-91baec3b5c94): created successfully Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (823d3890-31b9-440c-8d01-89c072b12e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Flow 'volume_create_manager' (b8b3ef29-52d0-436e-9753-5c99495c0bcb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:39:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-44e0af56-0015-4e95-9c77-1ae085af624a tempest-VolumesNegativeTest-122562947 None] Created volume successfully. Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "cinder-a218625d-9bf8-4a18-a318-32db5ff4725c-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-a218625d-9bf8-4a18-a318-32db5ff4725c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "cinder-quobyte-7b150fd7-1582-4da5-b409-d300ddc0811b" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-quobyte-7b150fd7-1582-4da5-b409-d300ddc0811b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "cinder-quobyte-a218625d-9bf8-4a18-a318-32db5ff4725c" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-quobyte-a218625d-9bf8-4a18-a318-32db5ff4725c" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Deleting offline snapshot a218625d-9bf8-4a18-a318-32db5ff4725c of volume 7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] snapshot_file for this snap is: volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[58fc2c50-dd72-43bf-a0a8-39dc0eaf4192]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:17 devstack sudo[95254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c Sep 18 00:39:17 devstack sudo[95254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:17 devstack sudo[95254]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c" returned: 0 in 0.376s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7b150fd7-1582-4da5-b409-d300ddc0811b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d48d226-52c6-4f72-9d32-dce100f60bfb]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:39:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:18 devstack sudo[95259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b Sep 18 00:39:18 devstack sudo[95259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:18 devstack sudo[95259]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b" returned: 0 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:18 devstack sudo[95267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c Sep 18 00:39:18 devstack sudo[95267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:18 devstack sudo[95267]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c" returned: 0 in 0.571s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:18 devstack sudo[95273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c Sep 18 00:39:18 devstack sudo[95273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:19 devstack sudo[95273]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b.a218625d-9bf8-4a18-a318-32db5ff4725c" returned: 0 in 0.347s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-quobyte-a218625d-9bf8-4a18-a318-32db5ff4725c" released by "_delete_snapshot" :: held 1.858s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-quobyte-7b150fd7-1582-4da5-b409-d300ddc0811b" released by "delete_snapshot" :: held 1.880s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Created reservations ['cb1c1d5d-63c9-4f2c-869f-f8ac648daaf7', 'fd3853dd-7454-44d8-83e0-7aaa7a6530e6', '0a2d3ff3-e21f-4982-8aef-cced3c45f998', '0cf3dd17-5a65-4684-bb94-92919694b518'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:39:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Delete snapshot completed successfully. Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fbc24c6c-9f33-4c6f-bfaa-4a951e754973 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-a218625d-9bf8-4a18-a318-32db5ff4725c-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "cinder-7b150fd7-1582-4da5-b409-d300ddc0811b-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-7b150fd7-1582-4da5-b409-d300ddc0811b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "cinder-quobyte-7b150fd7-1582-4da5-b409-d300ddc0811b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-quobyte-7b150fd7-1582-4da5-b409-d300ddc0811b" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1ded02c-2f19-4c5b-9a54-20c2a1e858e4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:39:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:20 devstack sudo[95279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b Sep 18 00:39:20 devstack sudo[95279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:20 devstack sudo[95279]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b" returned: 0 in 0.436s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:20 devstack sudo[95290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b Sep 18 00:39:20 devstack sudo[95290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:20 devstack sudo[95290]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7b150fd7-1582-4da5-b409-d300ddc0811b" returned: 0 in 0.365s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-quobyte-7b150fd7-1582-4da5-b409-d300ddc0811b" released by "delete_volume" :: held 0.922s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:20 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Created reservations ['4b049da8-b3e7-486f-8a94-49eaec54835e', '6685bd85-89a1-43d7-973d-23e1860cbe83', '8171a91a-501f-4b19-8a3e-b880897f7ca1', 'bfd639da-6a94-42fb-8f81-07566058c4eb'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:21 devstack sudo[95305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:39:21 devstack sudo[95305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:21 devstack sudo[95305]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.297s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:39:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Deleted volume successfully. Sep 18 00:39:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-70ce1a6f-7fbe-4d8e-b310-52f187532b28 tempest-VolumesSnapshotNegativeTestJSON-1097196619 None] Lock "cinder-7b150fd7-1582-4da5-b409-d300ddc0811b-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:31 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=13,cinder:UPDATE=25,cinder:INSERT=8,cinder:DELETE=3 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:39:31 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=23,cinder:UPDATE=17,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:39:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Acquiring lock "cinder-913ffd2c-fb2e-4a20-8358-91baec3b5c94-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:39:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Lock "cinder-913ffd2c-fb2e-4a20-8358-91baec3b5c94-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:39:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Acquiring lock "cinder-quobyte-913ffd2c-fb2e-4a20-8358-91baec3b5c94" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:39:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Lock "cinder-quobyte-913ffd2c-fb2e-4a20-8358-91baec3b5c94" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:39:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[cee10a98-9a65-44e8-9c88-356eaaaca312]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:39:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:49 devstack sudo[95634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 Sep 18 00:39:49 devstack sudo[95634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:49 devstack sudo[95634]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94" returned: 0 in 0.701s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:49 devstack sudo[95642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94 Sep 18 00:39:49 devstack sudo[95642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:50 devstack sudo[95642]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-913ffd2c-fb2e-4a20-8358-91baec3b5c94" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Lock "cinder-quobyte-913ffd2c-fb2e-4a20-8358-91baec3b5c94" released by "delete_volume" :: held 1.148s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Created reservations ['8dd55e90-5127-4369-a133-f85335a1f9b1', '69ee19a0-57d1-44aa-9f65-662e2cb45953', '1c607066-d22f-4bc8-969b-da1c33e1048f', 'b4647673-cf1e-4ac0-9be4-512ef00195d7'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:50 devstack sudo[95647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:39:50 devstack sudo[95647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:50 devstack sudo[95647]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.311s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:39:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Deleted volume successfully. Sep 18 00:39:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a9f58f2c-f23f-4967-8c41-d4116f302182 tempest-VolumesNegativeTest-122562947 None] Lock "cinder-913ffd2c-fb2e-4a20-8358-91baec3b5c94-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Flow 'volume_create_manager' (f9c3b5fc-96c0-45f4-9ecf-8599cc8f4707) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec742bc-b3c5-4a4b-b2fc-4183242fd518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ec742bc-b3c5-4a4b-b2fc-4183242fd518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1147823308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115b1216-259a-4a23-8055-c9ccaa08a6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8483a9df1cdf4321bec757adb6129445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:39:51Z,use_quota=True,user_id='0a6c2bceab084afdb49e2fcb9ed39ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7b48c4-9da4-489e-9d77-3686c58533e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7b48c4-9da4-489e-9d77-3686c58533e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b528d12a-bd71-4a00-a13d-9a559fc348b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b528d12a-bd71-4a00-a13d-9a559fc348b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '115b1216-259a-4a23-8055-c9ccaa08a6c1', 'volume_name': 'volume-115b1216-259a-4a23-8055-c9ccaa08a6c1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c9897-5019-4ec2-a82e-630de97012b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (216c9897-5019-4ec2-a82e-630de97012b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5389e5-5503-42f9-ad68-6cdcad1e96d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:51 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Volume 115b1216-259a-4a23-8055-c9ccaa08a6c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-115b1216-259a-4a23-8055-c9ccaa08a6c1', 'volume_size': 1} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1147823308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=115b1216-259a-4a23-8055-c9ccaa08a6c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8483a9df1cdf4321bec757adb6129445',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:39:51Z,use_quota=True,user_id='0a6c2bceab084afdb49e2fcb9ed39ae5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Creating volume 115b1216-259a-4a23-8055-c9ccaa08a6c1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:39:51 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:39:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:51 devstack sudo[95651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 1073741824 Sep 18 00:39:51 devstack sudo[95651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:52 devstack sudo[95651]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 1073741824" returned: 0 in 1.072s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:39:52 devstack sudo[95657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 Sep 18 00:39:52 devstack sudo[95657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:39:52 devstack sudo[95657]: pam_unix(sudo:session): session closed for user root Sep 18 00:39:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1" returned: 0 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:39:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] <== create_volume: return (1541ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:39:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.544s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:39:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cf5389e5-5503-42f9-ad68-6cdcad1e96d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-115b1216-259a-4a23-8055-c9ccaa08a6c1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362096d2-8629-44db-91b6-d2da78e1c43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:39:53 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Volume volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 (115b1216-259a-4a23-8055-c9ccaa08a6c1): created successfully Sep 18 00:39:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (362096d2-8629-44db-91b6-d2da78e1c43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:39:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Flow 'volume_create_manager' (f9c3b5fc-96c0-45f4-9ecf-8599cc8f4707) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:39:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d434c96e-f377-4f49-8591-c9251cb2ad06 tempest-AttachVolumeShelveTestJSON-1467874166 None] Created volume successfully. Sep 18 00:40:03 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=14,cinder:SELECT=7,cinder:INSERT=2 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:40:03 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=2 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:04 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:40:04 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:04 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.311s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:40:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:40:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-f6156041-a224-4444-ab0d-4b56cd3e3929 req-621597f6-52b2-4dbb-9581-d7592d0d8e48 tempest-AttachVolumeShelveTestJSON-1467874166 None] No connector for attachment 71996043-ea96-4205-aa02-564628c54600; skipping storage backend terminate_connection call. {{(pid=86526) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 18 00:40:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-f6156041-a224-4444-ab0d-4b56cd3e3929 req-621597f6-52b2-4dbb-9581-d7592d0d8e48 tempest-AttachVolumeShelveTestJSON-1467874166 None] Deleting attachment 71996043-ea96-4205-aa02-564628c54600. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:40:13 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:40:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Flow 'volume_create_manager' (70ec845e-30b4-4a3c-99ad-d17f9a4cb584) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e00de0b-1bdd-4680-8b3f-cd587869ab62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e00de0b-1bdd-4680-8b3f-cd587869ab62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2080911516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06e3a50-37e6-4c8d-94aa-653a305163b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610772a6c61e48f282e54d4327d54d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:14Z,use_quota=True,user_id='37979e4a9d884b02927241016f578be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c15b29f-fe53-42db-b95d-632cfea416ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c15b29f-fe53-42db-b95d-632cfea416ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c14a2f-65ab-4662-af98-4a2050f92c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33c14a2f-65ab-4662-af98-4a2050f92c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a06e3a50-37e6-4c8d-94aa-653a305163b1', 'volume_name': 'volume-a06e3a50-37e6-4c8d-94aa-653a305163b1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d628afc8-8a6c-4c14-b5f2-82ed17b500f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d628afc8-8a6c-4c14-b5f2-82ed17b500f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe561aa7-9482-48fa-8699-1adc03a49d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Volume a06e3a50-37e6-4c8d-94aa-653a305163b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a06e3a50-37e6-4c8d-94aa-653a305163b1', 'volume_size': 1} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2080911516',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a06e3a50-37e6-4c8d-94aa-653a305163b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610772a6c61e48f282e54d4327d54d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:14Z,use_quota=True,user_id='37979e4a9d884b02927241016f578be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Creating volume a06e3a50-37e6-4c8d-94aa-653a305163b1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:40:14 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:40:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:14 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 1073741824 Sep 18 00:40:14 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:15 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 1073741824" returned: 0 in 1.023s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:15 devstack sudo[95892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 Sep 18 00:40:15 devstack sudo[95892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:15 devstack sudo[95892]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1" returned: 0 in 0.614s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] <== create_volume: return (1722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.732s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe561aa7-9482-48fa-8699-1adc03a49d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a06e3a50-37e6-4c8d-94aa-653a305163b1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f97998-8e58-4b49-99d1-b26af8bcd42f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Volume volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 (a06e3a50-37e6-4c8d-94aa-653a305163b1): created successfully Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27f97998-8e58-4b49-99d1-b26af8bcd42f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Flow 'volume_create_manager' (70ec845e-30b4-4a3c-99ad-d17f9a4cb584) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-615d203f-87fc-4c64-bfce-08be7f4d3720 tempest-AttachVolumeTestJSON-1494072351 None] Created volume successfully. Sep 18 00:40:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b0e44139-1aa9-472c-a9ff-6e9659302028 req-6caa4910-0455-450d-b881-7dfead1fb904 tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b0e44139-1aa9-472c-a9ff-6e9659302028 req-6caa4910-0455-450d-b881-7dfead1fb904 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b0e44139-1aa9-472c-a9ff-6e9659302028 req-6caa4910-0455-450d-b881-7dfead1fb904 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.050s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-b0e44139-1aa9-472c-a9ff-6e9659302028 req-6caa4910-0455-450d-b881-7dfead1fb904 tempest-AttachVolumeTestJSON-1494072351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-a06e3a50-37e6-4c8d-94aa-653a305163b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c211ba10-45da-4aba-87b4-5be0fe77dae3', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:40:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b0e44139-1aa9-472c-a9ff-6e9659302028 req-6caa4910-0455-450d-b881-7dfead1fb904 tempest-AttachVolumeTestJSON-1494072351 None] attachment_update completed successfully. Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Flow 'volume_create_manager' (bb556385-15c3-40a8-a34f-19ca3ae35f60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f14b61e-c84d-4432-ac16-f0b69007f665) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0f14b61e-c84d-4432-ac16-f0b69007f665) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-643697774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7caed2d1-5f78-4adf-994b-0f6eb58cc3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddefb8530b74b1681aed9d602aee493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:21Z,use_quota=True,user_id='33a868681a7c43a099f4e8cda83108d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c21322-6226-49e9-a7c9-3d67ae55e3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01c21322-6226-49e9-a7c9-3d67ae55e3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5667d14-5a68-4699-ab63-e42d214ec08a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b5667d14-5a68-4699-ab63-e42d214ec08a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7caed2d1-5f78-4adf-994b-0f6eb58cc3ef', 'volume_name': 'volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3612e7-8108-4c3e-ba10-2861a1686425) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b3612e7-8108-4c3e-ba10-2861a1686425) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3218dbe-84a3-4225-802c-239adb095768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Volume 7caed2d1-5f78-4adf-994b-0f6eb58cc3ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef', 'volume_size': 1} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-643697774',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7caed2d1-5f78-4adf-994b-0f6eb58cc3ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6ddefb8530b74b1681aed9d602aee493',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:21Z,use_quota=True,user_id='33a868681a7c43a099f4e8cda83108d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Creating volume 7caed2d1-5f78-4adf-994b-0f6eb58cc3ef {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:40:20 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:40:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:20 devstack sudo[96339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef 1073741824 Sep 18 00:40:20 devstack sudo[96339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:21 devstack sudo[96339]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef 1073741824" returned: 0 in 1.006s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:21 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:40:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Flow 'volume_create_manager' (0de498a7-45dc-4cd9-8211-30a8056c4928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37455f7-17f1-45fd-b918-300fb10fcad1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a37455f7-17f1-45fd-b918-300fb10fcad1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-790815891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db92baa-c76b-4b60-97f9-5dfea01e35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610772a6c61e48f282e54d4327d54d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:22Z,use_quota=True,user_id='37979e4a9d884b02927241016f578be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446101a5-d460-4db4-ba27-0fed29a42f86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (446101a5-d460-4db4-ba27-0fed29a42f86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:22 devstack sudo[96362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef Sep 18 00:40:22 devstack sudo[96362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d13d822-1e23-4a60-a865-007ea689d820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d13d822-1e23-4a60-a865-007ea689d820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3db92baa-c76b-4b60-97f9-5dfea01e35bd', 'volume_name': 'volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d3c792-4492-484a-8c59-4a01d787360b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d3c792-4492-484a-8c59-4a01d787360b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421bee67-a1aa-4bba-983f-ad80984a2cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Volume 3db92baa-c76b-4b60-97f9-5dfea01e35bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd', 'volume_size': 1} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:22 devstack sudo[96362]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef" returned: 0 in 0.356s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] <== create_volume: return (1507ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.509s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.277s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-790815891',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3db92baa-c76b-4b60-97f9-5dfea01e35bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='610772a6c61e48f282e54d4327d54d1f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:22Z,use_quota=True,user_id='37979e4a9d884b02927241016f578be5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Creating volume 3db92baa-c76b-4b60-97f9-5dfea01e35bd {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:40:22 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:22 devstack sudo[96373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd 1073741824 Sep 18 00:40:22 devstack sudo[96373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b3218dbe-84a3-4225-802c-239adb095768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b6aeb9-c9e2-4dd9-a5a0-547985e0cf37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Volume volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef (7caed2d1-5f78-4adf-994b-0f6eb58cc3ef): created successfully Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1b6aeb9-c9e2-4dd9-a5a0-547985e0cf37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Flow 'volume_create_manager' (bb556385-15c3-40a8-a34f-19ca3ae35f60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-463ca883-11f7-4662-8d2e-82598d213160 tempest-TestMinimumBasicScenario-939457661 None] Created volume successfully. Sep 18 00:40:23 devstack sudo[96373]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd 1073741824" returned: 0 in 0.850s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:23 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd Sep 18 00:40:23 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:23 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd" returned: 0 in 0.478s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] <== create_volume: return (1439ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.444s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (421bee67-a1aa-4bba-983f-ad80984a2cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb53f60-ffee-4dc3-aa9e-107f00460dec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Volume volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd (3db92baa-c76b-4b60-97f9-5dfea01e35bd): created successfully Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcb53f60-ffee-4dc3-aa9e-107f00460dec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Flow 'volume_create_manager' (0de498a7-45dc-4cd9-8211-30a8056c4928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1815e24b-87fa-416f-97b6-779e2328a968 tempest-AttachVolumeTestJSON-1494072351 None] Created volume successfully. Sep 18 00:40:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-90584165-a044-4072-993e-9a6eb22d58b4 req-0941e99b-460b-49fb-b7a6-e37e567dbfbe tempest-TestMinimumBasicScenario-939457661 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-90584165-a044-4072-993e-9a6eb22d58b4 req-0941e99b-460b-49fb-b7a6-e37e567dbfbe tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-90584165-a044-4072-993e-9a6eb22d58b4 req-0941e99b-460b-49fb-b7a6-e37e567dbfbe tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.036s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-90584165-a044-4072-993e-9a6eb22d58b4 req-0941e99b-460b-49fb-b7a6-e37e567dbfbe tempest-TestMinimumBasicScenario-939457661 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '77afa395-9a12-42a9-b550-67a938bf1b2f', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:40:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-90584165-a044-4072-993e-9a6eb22d58b4 req-0941e99b-460b-49fb-b7a6-e37e567dbfbe tempest-TestMinimumBasicScenario-939457661 None] attachment_update completed successfully. Sep 18 00:40:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b80ea0d0-426f-4885-8a55-70b211a59584 req-0db7bdbe-b259-4dea-80c3-25fbd266bcab tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b80ea0d0-426f-4885-8a55-70b211a59584 req-0db7bdbe-b259-4dea-80c3-25fbd266bcab tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b80ea0d0-426f-4885-8a55-70b211a59584 req-0db7bdbe-b259-4dea-80c3-25fbd266bcab tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.023s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-b80ea0d0-426f-4885-8a55-70b211a59584 req-0db7bdbe-b259-4dea-80c3-25fbd266bcab tempest-AttachVolumeTestJSON-1494072351 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '63995fa7-dce0-44c9-b336-858712723e99', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:40:26 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b80ea0d0-426f-4885-8a55-70b211a59584 req-0db7bdbe-b259-4dea-80c3-25fbd266bcab tempest-AttachVolumeTestJSON-1494072351 None] attachment_update completed successfully. Sep 18 00:40:30 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-4fb4b8de-c361-40f3-b5f8-47dffcdacfc3 req-c2654f24-ff03-4a8a-a8dd-de965cbb9b3c tempest-AttachVolumeTestJSON-1494072351 None] Terminate volume connection completed successfully. Sep 18 00:40:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-4fb4b8de-c361-40f3-b5f8-47dffcdacfc3 req-c2654f24-ff03-4a8a-a8dd-de965cbb9b3c tempest-AttachVolumeTestJSON-1494072351 None] Deleting attachment c211ba10-45da-4aba-87b4-5be0fe77dae3. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:40:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-32808976-54a1-4a43-9642-34610dd6972c req-2d3e6681-f18d-4918-b07b-167f5abd74e8 tempest-AttachVolumeTestJSON-1494072351 None] Terminate volume connection completed successfully. Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-32808976-54a1-4a43-9642-34610dd6972c req-2d3e6681-f18d-4918-b07b-167f5abd74e8 tempest-AttachVolumeTestJSON-1494072351 None] Deleting attachment 63995fa7-dce0-44c9-b336-858712723e99. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Flow 'volume_create_manager' (1c4c0a3e-e1a2-4fba-851d-391bcad99c92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19f03d6-aa75-41a5-9535-43ee478ea7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d19f03d6-aa75-41a5-9535-43ee478ea7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-845413371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a892fc37-634e-45c3-a238-9ffa3084efc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7624ab3740d04be18d42256a63344b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:33Z,use_quota=True,user_id='fff985aac65a49f497eea221c6aba4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e881c2f-b017-4125-acb7-b69fe0238fb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1e881c2f-b017-4125-acb7-b69fe0238fb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e379e4-f97f-4aa7-b5c1-53f057e65085) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8e379e4-f97f-4aa7-b5c1-53f057e65085) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a892fc37-634e-45c3-a238-9ffa3084efc5', 'volume_name': 'volume-a892fc37-634e-45c3-a238-9ffa3084efc5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1490dbce-063b-4aad-9a5e-0461106b1573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1490dbce-063b-4aad-9a5e-0461106b1573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95702c9-bfb2-4f48-9f88-fe89e4249b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Volume a892fc37-634e-45c3-a238-9ffa3084efc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a892fc37-634e-45c3-a238-9ffa3084efc5', 'volume_size': 1} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-845413371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a892fc37-634e-45c3-a238-9ffa3084efc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7624ab3740d04be18d42256a63344b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:33Z,use_quota=True,user_id='fff985aac65a49f497eea221c6aba4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Creating volume a892fc37-634e-45c3-a238-9ffa3084efc5 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:40:32 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:40:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:32 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 1073741824 Sep 18 00:40:32 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Flow 'volume_create_manager' (f432ad5a-afc7-49ca-bf89-6fab58dc79a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f4a157-129e-4483-a812-6798addb16b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62f4a157-129e-4483-a812-6798addb16b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1008834154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7624ab3740d04be18d42256a63344b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:33Z,use_quota=True,user_id='fff985aac65a49f497eea221c6aba4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb72f13-df56-4453-9744-8b996fe30acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ddb72f13-df56-4453-9744-8b996fe30acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55c2065-6bcb-4a06-a83d-e1c81f2dc5b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b55c2065-6bcb-4a06-a83d-e1c81f2dc5b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364', 'volume_name': 'volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0408e09d-e7e3-415d-b8b6-08c23dd5695c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0408e09d-e7e3-415d-b8b6-08c23dd5695c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8404bf5-82fc-4a1a-8856-baa7c4261d42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Volume 0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364', 'volume_size': 1} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:33 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 1073741824" returned: 0 in 0.973s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:33 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 Sep 18 00:40:33 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:34 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5" returned: 0 in 0.643s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] <== create_volume: return (1746ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.758s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.098s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1008834154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7624ab3740d04be18d42256a63344b20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:33Z,use_quota=True,user_id='fff985aac65a49f497eea221c6aba4dd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Creating volume 0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:40:34 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b95702c9-bfb2-4f48-9f88-fe89e4249b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a892fc37-634e-45c3-a238-9ffa3084efc5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:34 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 1073741824 Sep 18 00:40:34 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cf04d1-c65c-4a4d-853a-4553021e22e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Volume volume-a892fc37-634e-45c3-a238-9ffa3084efc5 (a892fc37-634e-45c3-a238-9ffa3084efc5): created successfully Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7cf04d1-c65c-4a4d-853a-4553021e22e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Flow 'volume_create_manager' (1c4c0a3e-e1a2-4fba-851d-391bcad99c92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:34 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6dae16e7-9fef-4de3-8988-2a86644023aa tempest-TestServerVolumeAttachmentScenario-676474951 None] Created volume successfully. Sep 18 00:40:35 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 1073741824" returned: 0 in 0.713s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:35 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 Sep 18 00:40:35 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:35 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364" returned: 0 in 0.376s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b8404bf5-82fc-4a1a-8856-baa7c4261d42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4802294-87e7-4ad5-8b8d-cd7c785ef674) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Volume volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 (0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364): created successfully Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4802294-87e7-4ad5-8b8d-cd7c785ef674) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Flow 'volume_create_manager' (f432ad5a-afc7-49ca-bf89-6fab58dc79a0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4fea8312-e339-49eb-8888-56f76a0abb24 tempest-TestServerVolumeAttachmentScenario-676474951 None] Created volume successfully. Sep 18 00:40:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "cinder-3db92baa-c76b-4b60-97f9-5dfea01e35bd-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-3db92baa-c76b-4b60-97f9-5dfea01e35bd-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "cinder-quobyte-3db92baa-c76b-4b60-97f9-5dfea01e35bd" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-quobyte-3db92baa-c76b-4b60-97f9-5dfea01e35bd" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a04a76-4f89-4a07-ad36-a5c2c9c699f3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:40:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:40 devstack sudo[96592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd Sep 18 00:40:40 devstack sudo[96592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:41 devstack sudo[96592]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd" returned: 0 in 0.566s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:41 devstack sudo[96597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd Sep 18 00:40:41 devstack sudo[96597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:41 devstack sudo[96597]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3db92baa-c76b-4b60-97f9-5dfea01e35bd" returned: 0 in 0.375s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-quobyte-3db92baa-c76b-4b60-97f9-5dfea01e35bd" released by "delete_volume" :: held 1.066s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Created reservations ['c9fe8ae6-67eb-42f4-910c-3282617c3d21', 'a86ae2c4-e9ed-4d7e-a940-d2850115afff', 'bb38ddd2-2bcf-4865-a99c-4929ad896d39', 'f537e975-03e0-47d5-ad4f-24b3f248fb45'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:41 devstack sudo[96603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:40:41 devstack sudo[96603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:42 devstack sudo[96603]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.408s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:40:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Deleted volume successfully. Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7700bc10-d8b7-479a-9688-5986bc16caeb tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-3db92baa-c76b-4b60-97f9-5dfea01e35bd-delete_volume" released by "delete_volume" :: held 1.871s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "cinder-a06e3a50-37e6-4c8d-94aa-653a305163b1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-a06e3a50-37e6-4c8d-94aa-653a305163b1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "cinder-quobyte-a06e3a50-37e6-4c8d-94aa-653a305163b1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-quobyte-a06e3a50-37e6-4c8d-94aa-653a305163b1" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e05c1286-e35e-4306-9549-f0a76c760118]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:40:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:43 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 Sep 18 00:40:43 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:43 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1" returned: 0 in 0.586s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:43 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1 Sep 18 00:40:43 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:43 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a06e3a50-37e6-4c8d-94aa-653a305163b1" returned: 0 in 0.456s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-quobyte-a06e3a50-37e6-4c8d-94aa-653a305163b1" released by "delete_volume" :: held 1.133s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Created reservations ['d66d88cb-7fc0-4214-9f6f-c27b0d2cda48', 'efcf5ff0-dfb4-4988-a407-3375ff4b1232', 'd83741c2-ff11-49ae-a523-51f32ec5125b', '6a69d23e-491d-4404-bdb5-39427c9f6d60'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:44 devstack sudo[96628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:40:44 devstack sudo[96628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:44 devstack sudo[96628]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.305s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:40:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Deleted volume successfully. Sep 18 00:40:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ebfcc1fc-7a2b-44d5-a196-bd8c6ba6f42c tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-a06e3a50-37e6-4c8d-94aa-653a305163b1-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "cinder-33d1d57b-fd2b-491e-b622-15eb42985666-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-33d1d57b-fd2b-491e-b622-15eb42985666-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "cinder-quobyte-33d1d57b-fd2b-491e-b622-15eb42985666" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-quobyte-33d1d57b-fd2b-491e-b622-15eb42985666" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[458c93bd-9bae-4dda-90c7-d1ef650d0f9f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:45 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 Sep 18 00:40:45 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:45 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666" returned: 0 in 0.453s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:45 devstack sudo[96654]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666 Sep 18 00:40:45 devstack sudo[96654]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:46 devstack sudo[96654]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33d1d57b-fd2b-491e-b622-15eb42985666" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-quobyte-33d1d57b-fd2b-491e-b622-15eb42985666" released by "delete_volume" :: held 0.785s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Created reservations ['11e31757-9441-42a8-8396-9f99f2fd3ac2', 'ffe93a18-8ff3-41d0-9145-d1cb8c143a3c', 'a632d815-5e24-4a43-864b-f2d7a48ff314', 'a1dcc080-beaf-4efc-9475-86d0c564e618'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:46 devstack sudo[96660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:40:46 devstack sudo[96660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:47 devstack sudo[96660]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.660s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:47 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:40:47 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Deleted volume successfully. Sep 18 00:40:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cb057c58-807d-4d85-8ab0-89303315e94f tempest-AttachVolumeTestJSON-1494072351 None] Lock "cinder-33d1d57b-fd2b-491e-b622-15eb42985666-delete_volume" released by "delete_volume" :: held 1.799s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:56 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=46,cinder:INSERT=8,cinder:UPDATE=44,cinder:DELETE=5 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:40:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Acquiring lock "cinder-115b1216-259a-4a23-8055-c9ccaa08a6c1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "cinder-115b1216-259a-4a23-8055-c9ccaa08a6c1-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Acquiring lock "cinder-quobyte-115b1216-259a-4a23-8055-c9ccaa08a6c1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "cinder-quobyte-115b1216-259a-4a23-8055-c9ccaa08a6c1" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6c5b01-db23-47b1-b40e-f52f4cbd4d1b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:57 devstack sudo[96767]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 Sep 18 00:40:57 devstack sudo[96767]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:57 devstack sudo[96767]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1" returned: 0 in 0.499s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:57 devstack sudo[96783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1 Sep 18 00:40:57 devstack sudo[96783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:57 devstack sudo[96783]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-115b1216-259a-4a23-8055-c9ccaa08a6c1" returned: 0 in 0.360s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "cinder-quobyte-115b1216-259a-4a23-8055-c9ccaa08a6c1" released by "delete_volume" :: held 0.930s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Created reservations ['31e77726-3a9b-4eae-99f8-a2f9b04fb5fc', '9f7691e2-561b-4f1d-b2be-af2f97d82381', '5a9cc649-f976-41d1-9527-e04239c3c08c', 'b567f621-a263-4961-ad3f-1c873b27bc2a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:58 devstack sudo[96797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:40:58 devstack sudo[96797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:40:58 devstack sudo[96797]: pam_unix(sudo:session): session closed for user root Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.334s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:40:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Deleted volume successfully. Sep 18 00:40:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-00175dc6-6176-414b-9b27-c88bec6fa3fd tempest-AttachVolumeShelveTestJSON-1467874166 None] Lock "cinder-115b1216-259a-4a23-8055-c9ccaa08a6c1-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Flow 'volume_create_manager' (0cc19c9e-a02f-46d0-9291-db8ad4a44bee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26509a07-faec-49b9-b83b-5ad794b29bea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (26509a07-faec-49b9-b83b-5ad794b29bea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-82151921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbda6420-5da3-490c-9467-2a00fc41ad1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a1903032d7944dfac1c5eca34653a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:59Z,use_quota=True,user_id='ab0c3970101e49c2954a22676827a945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6a082d-3a9d-49eb-acd7-cfe85e0397fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff6a082d-3a9d-49eb-acd7-cfe85e0397fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61654aba-4df6-4b12-ae42-6da84a411d46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61654aba-4df6-4b12-ae42-6da84a411d46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbda6420-5da3-490c-9467-2a00fc41ad1c', 'volume_name': 'volume-fbda6420-5da3-490c-9467-2a00fc41ad1c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baee4d19-febc-4727-ba25-cfd0ff17aaf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (baee4d19-febc-4727-ba25-cfd0ff17aaf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4eae319-c2bd-4964-93fd-21cd657ff0e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:40:59 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Volume fbda6420-5da3-490c-9467-2a00fc41ad1c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbda6420-5da3-490c-9467-2a00fc41ad1c', 'volume_size': 1} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:40:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-82151921',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbda6420-5da3-490c-9467-2a00fc41ad1c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8a1903032d7944dfac1c5eca34653a15',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:40:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:40:59Z,use_quota=True,user_id='ab0c3970101e49c2954a22676827a945',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Creating volume fbda6420-5da3-490c-9467-2a00fc41ad1c {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:40:59 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:40:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:40:59 devstack sudo[96802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c 1073741824 Sep 18 00:40:59 devstack sudo[96802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:00 devstack sudo[96802]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c 1073741824" returned: 0 in 0.653s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:00 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c Sep 18 00:41:00 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:00 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c" returned: 0 in 0.548s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] <== create_volume: return (1288ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.292s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4eae319-c2bd-4964-93fd-21cd657ff0e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbda6420-5da3-490c-9467-2a00fc41ad1c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86dd5f-e827-45c9-842d-8b839738e60b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:00 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Volume volume-fbda6420-5da3-490c-9467-2a00fc41ad1c (fbda6420-5da3-490c-9467-2a00fc41ad1c): created successfully Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c86dd5f-e827-45c9-842d-8b839738e60b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Flow 'volume_create_manager' (0cc19c9e-a02f-46d0-9291-db8ad4a44bee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:41:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-0a0ae2b5-2b77-4953-aa83-8903829752ce req-3c070a0c-cd02-43dc-bdde-63ef3634add7 tempest-VolumesGetTestJSON-700629975 None] Created volume successfully. Sep 18 00:41:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Acquiring lock "cinder-fbda6420-5da3-490c-9467-2a00fc41ad1c-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Lock "cinder-fbda6420-5da3-490c-9467-2a00fc41ad1c-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Acquiring lock "cinder-quobyte-fbda6420-5da3-490c-9467-2a00fc41ad1c" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Lock "cinder-quobyte-fbda6420-5da3-490c-9467-2a00fc41ad1c" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:01 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3740ac2a-dc32-4f0a-b63d-722d080cab1e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:02 devstack sudo[96866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c Sep 18 00:41:02 devstack sudo[96866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:02 devstack sudo[96866]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c" returned: 0 in 0.411s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:02 devstack sudo[96872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c Sep 18 00:41:02 devstack sudo[96872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:02 devstack sudo[96872]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbda6420-5da3-490c-9467-2a00fc41ad1c" returned: 0 in 0.298s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Lock "cinder-quobyte-fbda6420-5da3-490c-9467-2a00fc41ad1c" released by "delete_volume" :: held 0.778s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG cinder.quota [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Created reservations ['c2c59086-3da0-445a-95e5-d83cebc6e0a9', 'cade9c59-db90-4f47-8f8d-b38e03f942b8', '8b1d440f-0e05-4578-9fb7-c8417aca45a2', 'b3928b12-5296-4118-89bc-e74d86b614d7'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:02 devstack sudo[96875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:41:02 devstack sudo[96875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:03 devstack sudo[96875]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.287s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:03 devstack cinder-volume[86526]: DEBUG cinder.manager [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:41:03 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Deleted volume successfully. Sep 18 00:41:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0515f4ae-7aa3-46ab-b02d-5fd3f3d6a9fe req-ed8bc79b-e043-47dd-bad6-f7da6c58a857 tempest-VolumesGetTestJSON-700629975 None] Lock "cinder-fbda6420-5da3-490c-9467-2a00fc41ad1c-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:04 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:41:04 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:04 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.438s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:41:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:41:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-04dda371-aeb9-45ad-ae1e-3d7ca41717a8 tempest-BackendsCapabilitiesAdminTestsJSON-2020450412 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.76655960083, 'free_capacity_gb': 1775.76655960083, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86526) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 00:41:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a4bb575f-cab3-4eba-bf3c-97ef2e518bcd tempest-BackendsCapabilitiesAdminTestsJSON-2020450412 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.76655960083, 'free_capacity_gb': 1775.76655960083, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86526) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 00:41:12 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=16,cinder:SELECT=14,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:41:13 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=59,cinder:UPDATE=65,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:41:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-739b5825-74c5-49d8-a6c7-7572b8bcb080 req-82129324-2427-4b50-b079-f669dcd1adc0 tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-739b5825-74c5-49d8-a6c7-7572b8bcb080 req-82129324-2427-4b50-b079-f669dcd1adc0 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-739b5825-74c5-49d8-a6c7-7572b8bcb080 req-82129324-2427-4b50-b079-f669dcd1adc0 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-739b5825-74c5-49d8-a6c7-7572b8bcb080 req-82129324-2427-4b50-b079-f669dcd1adc0 tempest-TestServerVolumeAttachmentScenario-676474951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-a892fc37-634e-45c3-a238-9ffa3084efc5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6a3b0052-4d94-4746-9333-a9a9a628e56e', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:41:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-739b5825-74c5-49d8-a6c7-7572b8bcb080 req-82129324-2427-4b50-b079-f669dcd1adc0 tempest-TestServerVolumeAttachmentScenario-676474951 None] attachment_update completed successfully. Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Flow 'volume_create_manager' (835e1c68-2a30-4fc1-a58c-05e4f174393a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238b524b-3dbc-43b4-81db-12d19da8b0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (238b524b-3dbc-43b4-81db-12d19da8b0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-864647211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec6a92e-7f84-4b9f-8c93-59891aad600c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d9ed6ea78445f68360edfef9d5f5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:41:16Z,use_quota=True,user_id='5a2d228f964149a5beaa90c7e91bae01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88ba4bc-1af3-453c-8d9b-1ec0f2b4cf8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88ba4bc-1af3-453c-8d9b-1ec0f2b4cf8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9839b07c-f54b-45f8-9827-cef341774e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9839b07c-f54b-45f8-9827-cef341774e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ec6a92e-7f84-4b9f-8c93-59891aad600c', 'volume_name': 'volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946a6801-4bf2-42c3-8b01-3219f9617296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (946a6801-4bf2-42c3-8b01-3219f9617296) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a931ce-c075-41ab-ba35-69390149f355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c', 'volume_size': 1} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:41:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-864647211',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ec6a92e-7f84-4b9f-8c93-59891aad600c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72d9ed6ea78445f68360edfef9d5f5f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:41:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:41:16Z,use_quota=True,user_id='5a2d228f964149a5beaa90c7e91bae01',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Creating volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:41:15 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:41:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:15 devstack sudo[96920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c 1073741824 Sep 18 00:41:15 devstack sudo[96920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:16 devstack sudo[96920]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c 1073741824" returned: 0 in 0.477s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:16 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c Sep 18 00:41:16 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:16 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c" returned: 0 in 0.282s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] <== create_volume: return (808ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52a931ce-c075-41ab-ba35-69390149f355) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0be583a-b9c8-4474-be4d-7ef1ca9ede90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Volume volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c (0ec6a92e-7f84-4b9f-8c93-59891aad600c): created successfully Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0be583a-b9c8-4474-be4d-7ef1ca9ede90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Flow 'volume_create_manager' (835e1c68-2a30-4fc1-a58c-05e4f174393a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:41:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6cc97d01-1c62-44fc-95a4-54cde191adc4 tempest-SnapshotsActionsTest-1477920779 None] Created volume successfully. Sep 18 00:41:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Creating offline snapshot 6138467b-da62-4992-a466-2e3246dd5177 of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:41:18 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8bad39f-5938-43fd-a9dd-cd5a09f8ce6d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:18 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c Sep 18 00:41:18 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:18 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c" returned: 0 in 0.410s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:18 devstack sudo[96936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 1G Sep 18 00:41:18 devstack sudo[96936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:19 devstack sudo[96936]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 1G" returned: 0 in 0.581s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:19 devstack sudo[96950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:19 devstack sudo[96950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-fbcf5685-f260-471d-979e-bf8e96e3769a req-71ae07a9-ab5e-4043-8093-d34268e96c60 tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:19 devstack sudo[96950]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:19 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 is being set with open permissions: ugo+rw Sep 18 00:41:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:19 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:19 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:19 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:20 devstack sudo[96958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.info Sep 18 00:41:20 devstack sudo[96958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:20 devstack sudo[96958]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.info" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:20 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.info is being set with open permissions: ugo+rw Sep 18 00:41:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:20 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.info Sep 18 00:41:20 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:20 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.info" returned: 0 in 0.287s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.403s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-fbcf5685-f260-471d-979e-bf8e96e3769a req-71ae07a9-ab5e-4043-8093-d34268e96c60 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.279s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-fbcf5685-f260-471d-979e-bf8e96e3769a req-71ae07a9-ab5e-4043-8093-d34268e96c60 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-567f85f9-b95a-4ac9-a009-9d010ee0d03b tempest-SnapshotsActionsTest-1477920779 None] Create snapshot completed successfully Sep 18 00:41:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-fbcf5685-f260-471d-979e-bf8e96e3769a req-71ae07a9-ab5e-4043-8093-d34268e96c60 tempest-TestServerVolumeAttachmentScenario-676474951 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '375e2191-9f60-44d8-964f-d5c1e1c59540', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:41:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-fbcf5685-f260-471d-979e-bf8e96e3769a req-71ae07a9-ab5e-4043-8093-d34268e96c60 tempest-TestServerVolumeAttachmentScenario-676474951 None] attachment_update completed successfully. Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Creating offline snapshot de466e8e-751f-477e-b69e-1f1e373bc0d8 of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d42263ec-92ad-4a6a-8f6b-09c240510c4c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:22 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:22 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:22 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.414s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:22 devstack sudo[96973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 1G Sep 18 00:41:22 devstack sudo[96973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-07f07ee0-d4c1-49b3-89a2-a72219619f7f req-b5f3e791-0021-40d9-8aa1-96ea823a68e5 tempest-TestServerVolumeAttachmentScenario-676474951 None] Terminate volume connection completed successfully. Sep 18 00:41:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-07f07ee0-d4c1-49b3-89a2-a72219619f7f req-b5f3e791-0021-40d9-8aa1-96ea823a68e5 tempest-TestServerVolumeAttachmentScenario-676474951 None] Deleting attachment 375e2191-9f60-44d8-964f-d5c1e1c59540. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:41:23 devstack sudo[96973]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 1G" returned: 0 in 0.616s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:23 devstack sudo[96985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 Sep 18 00:41:23 devstack sudo[96985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:23 devstack sudo[96985]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8" returned: 0 in 0.352s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:23 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 is being set with open permissions: ugo+rw Sep 18 00:41:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:23 devstack sudo[96991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 Sep 18 00:41:23 devstack sudo[96991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:23 devstack sudo[96991]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.767s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4da70262-8f67-4126-ae5e-155da74f36b2 tempest-SnapshotsActionsTest-1477920779 None] Create snapshot completed successfully Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-de466e8e-751f-477e-b69e-1f1e373bc0d8-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-de466e8e-751f-477e-b69e-1f1e373bc0d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-de466e8e-751f-477e-b69e-1f1e373bc0d8" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-de466e8e-751f-477e-b69e-1f1e373bc0d8" acquired by "_delete_snapshot" :: waited 0.031s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Deleting offline snapshot de466e8e-751f-477e-b69e-1f1e373bc0d8 of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] snapshot_file for this snap is: volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a57703-83e0-44b3-bacf-05331bc958ee]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:24 devstack sudo[96998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 Sep 18 00:41:24 devstack sudo[96998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:25 devstack sudo[96998]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8" returned: 0 in 0.688s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1abf075a-ddad-47b5-bf50-248c8694c50b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-8ad03f09-1400-4e71-8efd-f2690ac73e0b req-f33ad1d1-eabc-4e4e-832d-47ce054b6ee5 tempest-TestServerVolumeAttachmentScenario-676474951 None] Terminate volume connection completed successfully. Sep 18 00:41:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-8ad03f09-1400-4e71-8efd-f2690ac73e0b req-f33ad1d1-eabc-4e4e-832d-47ce054b6ee5 tempest-TestServerVolumeAttachmentScenario-676474951 None] Deleting attachment 6a3b0052-4d94-4746-9333-a9a9a628e56e. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:41:25 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:25 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:26 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.608s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:26 devstack sudo[97012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 Sep 18 00:41:26 devstack sudo[97012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:26 devstack sudo[97012]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8" returned: 0 in 0.642s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:26 devstack sudo[97018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8 Sep 18 00:41:26 devstack sudo[97018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-cd03f85b-8992-4a38-9d9b-79fd71161e19 req-0f206f3c-2b2b-4557-adc9-b7d930b7219d tempest-TestMinimumBasicScenario-939457661 None] Terminate volume connection completed successfully. Sep 18 00:41:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-cd03f85b-8992-4a38-9d9b-79fd71161e19 req-0f206f3c-2b2b-4557-adc9-b7d930b7219d tempest-TestMinimumBasicScenario-939457661 None] Deleting attachment 77afa395-9a12-42a9-b550-67a938bf1b2f. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:41:27 devstack sudo[97018]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.de466e8e-751f-477e-b69e-1f1e373bc0d8" returned: 0 in 0.456s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-de466e8e-751f-477e-b69e-1f1e373bc0d8" released by "_delete_snapshot" :: held 2.648s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" released by "delete_snapshot" :: held 2.702s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:27 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Created reservations ['3b3278d0-8011-478f-9d8a-4443da768451', '90edf5e6-9816-4253-ba89-fe2bae6c01ea', 'f5f0bdf5-1d9f-4557-861c-c5d088f63227', '6353345e-9180-48d0-a153-79fb4016bb41'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Delete snapshot completed successfully. Sep 18 00:41:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-25582e6b-c489-4e5e-a2f0-b47a74d21e15 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-de466e8e-751f-477e-b69e-1f1e373bc0d8-delete_snapshot" released by "delete_snapshot" :: held 3.026s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Creating offline snapshot a998208c-f57a-4384-b5f0-2158e0cc1fce of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f4a01b7-28b9-4f6e-98b6-2bb1eb62891e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:28 devstack sudo[97062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:28 devstack sudo[97062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:28 devstack sudo[97062]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.487s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:28 devstack sudo[97069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce 1G Sep 18 00:41:28 devstack sudo[97069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:29 devstack sudo[97069]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce 1G" returned: 0 in 0.713s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:29 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce Sep 18 00:41:29 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Acquiring lock "cinder-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Lock "cinder-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Acquiring lock "cinder-quobyte-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Lock "cinder-quobyte-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[18825ab4-c012-4874-8f36-e50296a15c1e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:29 devstack sudo[97078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef Sep 18 00:41:29 devstack sudo[97078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:29 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce" returned: 0 in 0.415s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:29 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce is being set with open permissions: ugo+rw Sep 18 00:41:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:29 devstack sudo[97084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce Sep 18 00:41:29 devstack sudo[97084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:30 devstack sudo[97078]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef" returned: 0 in 0.436s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:30 devstack sudo[97084]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:30 devstack sudo[97091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef Sep 18 00:41:30 devstack sudo[97091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.080s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:30 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-48460258-9a69-4d65-9d5d-469b52587368 tempest-SnapshotsActionsTest-1477920779 None] Create snapshot completed successfully Sep 18 00:41:30 devstack sudo[97091]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Lock "cinder-quobyte-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef" released by "delete_volume" :: held 0.799s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Created reservations ['e6005d81-9aa4-4a59-b635-877272418455', '68543df1-8488-4e64-9984-951f9be4d025', 'f8e40956-e83d-4b1c-bf30-cf668037ecb8', 'cbae3a42-b958-4242-bc85-72d472310f48'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:30 devstack sudo[97096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:41:30 devstack sudo[97096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:31 devstack sudo[97096]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.528s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:41:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Deleted volume successfully. Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac67102-cbbe-4a1b-881f-95c01af5b831 tempest-TestMinimumBasicScenario-939457661 None] Lock "cinder-7caed2d1-5f78-4adf-994b-0f6eb58cc3ef-delete_volume" released by "delete_volume" :: held 1.647s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-a998208c-f57a-4384-b5f0-2158e0cc1fce-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-a998208c-f57a-4384-b5f0-2158e0cc1fce-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-a998208c-f57a-4384-b5f0-2158e0cc1fce" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-a998208c-f57a-4384-b5f0-2158e0cc1fce" acquired by "_delete_snapshot" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Deleting offline snapshot a998208c-f57a-4384-b5f0-2158e0cc1fce of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] snapshot_file for this snap is: volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[15253d2b-b57b-419c-86fa-7e7e482629f4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:32 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce Sep 18 00:41:32 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:32 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce" returned: 0 in 0.672s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:32 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7528d829-f2e5-462e-b096-60fc96977ddd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:32 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:32 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "cinder-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "cinder-quobyte-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-quobyte-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bacb3f25-5026-478b-a2ea-bab0341db4bf]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:33 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.860s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:33 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce Sep 18 00:41:33 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:33 devstack sudo[97196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 Sep 18 00:41:33 devstack sudo[97196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:34 devstack sudo[97196]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364" returned: 0 in 0.906s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:34 devstack sudo[97210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364 Sep 18 00:41:34 devstack sudo[97210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:34 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce" returned: 0 in 0.878s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:34 devstack sudo[97212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce Sep 18 00:41:34 devstack sudo[97212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:34 devstack sudo[97210]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364" returned: 0 in 0.574s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:34 devstack sudo[97212]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.a998208c-f57a-4384-b5f0-2158e0cc1fce" returned: 0 in 0.530s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-quobyte-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364" released by "delete_volume" :: held 1.635s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-a998208c-f57a-4384-b5f0-2158e0cc1fce" released by "_delete_snapshot" :: held 3.220s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" released by "delete_snapshot" :: held 3.274s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Created reservations ['9d341e1b-8dea-4ade-809c-72e27cf474f1', '421849c3-930a-4304-8239-456351d7cc3a', '97d34582-6cae-4266-9948-5b1aec23f7f2', 'e8d893cb-ff65-4df6-a6b0-bd80bfc99560'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Created reservations ['478b513b-929e-4242-8a56-d49fa9c42af5', '6f7721f3-1c6f-4e18-b147-2022e92d841e', '9d2b3e46-d6d9-47e3-9343-2f1ebbb84193', 'f83816db-364b-4b4a-adb1-2e67c3384fc3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:35 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:41:35 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Delete snapshot completed successfully. Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0a241c1e-f080-4c74-bd4f-1766d51034ea tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-a998208c-f57a-4384-b5f0-2158e0cc1fce-delete_snapshot" released by "delete_snapshot" :: held 3.642s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:35 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:41:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Deleted volume successfully. Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-edbcb939-3f73-41ab-8a56-764e182a0452 tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-0c0f7fd8-18c4-4a65-a2c9-d1a8bc894364-delete_volume" released by "delete_volume" :: held 2.433s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "cinder-a892fc37-634e-45c3-a238-9ffa3084efc5-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-a892fc37-634e-45c3-a238-9ffa3084efc5-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "cinder-quobyte-a892fc37-634e-45c3-a238-9ffa3084efc5" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-quobyte-a892fc37-634e-45c3-a238-9ffa3084efc5" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[41f47b15-1e45-4062-b10d-12dad110b46d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:36 devstack sudo[97219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 Sep 18 00:41:36 devstack sudo[97219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:36 devstack sudo[97219]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5" returned: 0 in 0.569s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:36 devstack sudo[97225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5 Sep 18 00:41:36 devstack sudo[97225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Creating offline snapshot 46129a21-4a5c-431b-baff-3efb6b76812f of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[828a4ae0-8a65-4f15-b723-5b23ac3f062f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:36 devstack sudo[97225]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a892fc37-634e-45c3-a238-9ffa3084efc5" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-quobyte-a892fc37-634e-45c3-a238-9ffa3084efc5" released by "delete_volume" :: held 1.071s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:37 devstack sudo[97229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:37 devstack sudo[97229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Created reservations ['915b1a06-4d4a-40ef-9f57-6d9a9f15f6dd', '660368ed-1f67-4085-842c-2d7337ed4b77', '47e7ebc2-83fa-4b50-9cb9-3732cdde3b6e', '720a2558-82db-4d6d-80c5-12c2a5978030'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:37 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:41:37 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:37 devstack sudo[97229]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.574s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:37 devstack sudo[97237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f 1G Sep 18 00:41:37 devstack sudo[97237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:37 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.356s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:41:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Deleted volume successfully. Sep 18 00:41:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c34b6d5-d06a-443a-9faa-843a5b58c60f tempest-TestServerVolumeAttachmentScenario-676474951 None] Lock "cinder-a892fc37-634e-45c3-a238-9ffa3084efc5-delete_volume" released by "delete_volume" :: held 1.930s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:38 devstack sudo[97237]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f 1G" returned: 0 in 0.762s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:38 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f Sep 18 00:41:38 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:38 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f" returned: 0 in 0.352s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:38 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f is being set with open permissions: ugo+rw Sep 18 00:41:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:38 devstack sudo[97251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f Sep 18 00:41:38 devstack sudo[97251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:38 devstack sudo[97251]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f" returned: 0 in 0.409s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.301s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-96defa2a-fd9f-471c-8f6e-4184b489e583 tempest-SnapshotsActionsTest-1477920779 None] Create snapshot completed successfully Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-46129a21-4a5c-431b-baff-3efb6b76812f-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-46129a21-4a5c-431b-baff-3efb6b76812f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-46129a21-4a5c-431b-baff-3efb6b76812f" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-46129a21-4a5c-431b-baff-3efb6b76812f" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Deleting offline snapshot 46129a21-4a5c-431b-baff-3efb6b76812f of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] snapshot_file for this snap is: volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab6ed6af-31d1-4e7c-aa36-c51f89b56c41]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:40 devstack sudo[97257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f Sep 18 00:41:40 devstack sudo[97257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:40 devstack sudo[97257]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f" returned: 0 in 0.621s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b819a17-b6ca-4e87-895e-c674adfa73e4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:40 devstack sudo[97264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:41 devstack sudo[97264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:41 devstack sudo[97264]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.547s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:41 devstack sudo[97270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f Sep 18 00:41:41 devstack sudo[97270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:41 devstack sudo[97270]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f" returned: 0 in 0.614s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:42 devstack sudo[97277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f Sep 18 00:41:42 devstack sudo[97277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:42 devstack sudo[97277]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.46129a21-4a5c-431b-baff-3efb6b76812f" returned: 0 in 0.335s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-46129a21-4a5c-431b-baff-3efb6b76812f" released by "_delete_snapshot" :: held 2.237s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" released by "delete_snapshot" :: held 2.276s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:42 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Created reservations ['6750dce9-c1c7-4dd6-ad1e-35b5a9dcca44', '48409859-e74f-4d5f-86f2-c11078d19477', '26c1702a-28f4-4f78-b29d-9aa3e2abac1a', '43c089e3-6eef-40d3-b023-501a208e305e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Delete snapshot completed successfully. Sep 18 00:41:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcb806a7-8850-4324-93c1-2a6597402595 tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-46129a21-4a5c-431b-baff-3efb6b76812f-delete_snapshot" released by "delete_snapshot" :: held 2.539s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Creating offline snapshot 60eaad0e-eb90-4f95-986d-f451689f0447 of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:41:44 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ced4a3b7-ee82-475c-a942-f1b33c50ad59]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:44 devstack sudo[97282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:44 devstack sudo[97282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:44 devstack sudo[97282]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.526s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:44 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 1G Sep 18 00:41:44 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:45 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 1G" returned: 0 in 0.758s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:45 devstack sudo[97293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 Sep 18 00:41:45 devstack sudo[97293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:45 devstack sudo[97293]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447" returned: 0 in 0.411s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:45 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 is being set with open permissions: ugo+rw Sep 18 00:41:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:45 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 Sep 18 00:41:45 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:46 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447" returned: 0 in 0.452s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.390s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6f5e5d2b-8808-4b35-916b-53ec5dc057b7 tempest-SnapshotsActionsTest-1477920779 None] Create snapshot completed successfully Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-60eaad0e-eb90-4f95-986d-f451689f0447-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-60eaad0e-eb90-4f95-986d-f451689f0447-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Acquiring lock "cinder-quobyte-60eaad0e-eb90-4f95-986d-f451689f0447" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-60eaad0e-eb90-4f95-986d-f451689f0447" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Deleting offline snapshot 60eaad0e-eb90-4f95-986d-f451689f0447 of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] snapshot_file for this snap is: volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[19f16a71-db99-4ae9-88c1-f97242bcc976]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:47 devstack sudo[97333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 Sep 18 00:41:47 devstack sudo[97333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:47 devstack sudo[97333]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b2464c0-aeaa-416f-9b16-fda525f5f62b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:47 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:47 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:48 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.429s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:48 devstack sudo[97344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 Sep 18 00:41:48 devstack sudo[97344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:48 devstack sudo[97344]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447" returned: 0 in 0.407s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:48 devstack sudo[97349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447 Sep 18 00:41:48 devstack sudo[97349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:48 devstack sudo[97349]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.60eaad0e-eb90-4f95-986d-f451689f0447" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-60eaad0e-eb90-4f95-986d-f451689f0447" released by "_delete_snapshot" :: held 1.662s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" released by "delete_snapshot" :: held 1.688s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Created reservations ['074a4d46-7f8e-4c5b-9288-cb5cb5120a4c', '64ce0aba-b2fe-48b3-8eb9-0f226872254c', '36835fe2-f00c-41d9-bb8a-685250dfac7e', '4e355dbf-b9a3-4094-ad01-611ad9e55965'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Delete snapshot completed successfully. Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e650cd4c-16df-489b-9062-967fd925b59d tempest-SnapshotsActionsTest-1014520014 None] Lock "cinder-60eaad0e-eb90-4f95-986d-f451689f0447-delete_snapshot" released by "delete_snapshot" :: held 1.932s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "cinder-6138467b-da62-4992-a466-2e3246dd5177-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-6138467b-da62-4992-a466-2e3246dd5177-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "cinder-quobyte-6138467b-da62-4992-a466-2e3246dd5177" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-quobyte-6138467b-da62-4992-a466-2e3246dd5177" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Deleting offline snapshot 6138467b-da62-4992-a466-2e3246dd5177 of volume 0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] snapshot_file for this snap is: volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[52d07c42-703a-4f9c-8503-6676b8373c28]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:50 devstack sudo[97353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:50 devstack sudo[97353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:50 devstack sudo[97353]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.403s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:41:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf78d5eb-49a2-44ba-abd8-1e7487fb4107]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:50 devstack sudo[97359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c Sep 18 00:41:50 devstack sudo[97359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:50 devstack sudo[97359]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c" returned: 0 in 0.411s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:50 devstack sudo[97365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:50 devstack sudo[97365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:51 devstack sudo[97365]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.451s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:51 devstack sudo[97371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177 Sep 18 00:41:51 devstack sudo[97371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:51 devstack sudo[97371]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c.6138467b-da62-4992-a466-2e3246dd5177" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-quobyte-6138467b-da62-4992-a466-2e3246dd5177" released by "_delete_snapshot" :: held 1.741s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" released by "delete_snapshot" :: held 1.778s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:51 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Created reservations ['60cf5c72-4575-4b5b-912d-fa8ee1da1b99', '5971d648-04b6-4fd1-8622-979495eab51e', '128da06e-9f68-445e-8e9a-43ba68b0139b', '49ec38aa-c5a6-4574-a0e1-639470860028'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Delete snapshot completed successfully. Sep 18 00:41:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d847b154-a4e6-4a66-a83c-a62cd7c196b5 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-6138467b-da62-4992-a466-2e3246dd5177-delete_snapshot" released by "delete_snapshot" :: held 1.966s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "cinder-0ec6a92e-7f84-4b9f-8c93-59891aad600c-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-0ec6a92e-7f84-4b9f-8c93-59891aad600c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[41eb551b-39fa-41bb-8a2c-ae14d7341a3e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:52 devstack sudo[97374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c Sep 18 00:41:52 devstack sudo[97374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:52 devstack sudo[97374]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c" returned: 0 in 0.440s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:52 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c Sep 18 00:41:52 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:53 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ec6a92e-7f84-4b9f-8c93-59891aad600c" returned: 0 in 0.312s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-quobyte-0ec6a92e-7f84-4b9f-8c93-59891aad600c" released by "delete_volume" :: held 0.854s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Created reservations ['51b2a20e-55ee-49be-8ad5-05bb88973c4f', 'ab0181b1-b3d9-45c5-8fc8-a8be9740142f', 'e7427638-42ad-4747-9833-d98bde256cbf', 'd7be2511-6640-439b-b64b-5bd074217b14'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:53 devstack sudo[97383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:41:53 devstack sudo[97383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:53 devstack sudo[97383]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:41:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Deleted volume successfully. Sep 18 00:41:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e2d79b30-8128-4f14-a7b8-6b24397bde32 tempest-SnapshotsActionsTest-1477920779 None] Lock "cinder-0ec6a92e-7f84-4b9f-8c93-59891aad600c-delete_volume" released by "delete_volume" :: held 1.530s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Flow 'volume_create_manager' (6783138c-3fb9-4590-b0f2-ec7c5514242c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1999206f-9d78-42ac-a3d7-96d86e72a623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1999206f-9d78-42ac-a3d7-96d86e72a623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74fe3123fab4a91b77674f6141448e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:41:56Z,use_quota=True,user_id='5aa81ce124404e8c94e7514ab56220f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83065534-f0fb-4a20-a1df-c63af1fb77b4),volume_type_id=83065534-f0fb-4a20-a1df-c63af1fb77b4)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf30228f-3443-4f83-b251-7976920673af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf30228f-3443-4f83-b251-7976920673af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3547c3-d115-4891-8869-d1e616161ac0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:56 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a3547c3-d115-4891-8869-d1e616161ac0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f', 'volume_name': 'volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f', 'volume_size': 1, 'image_id': '179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db3935b3ce6e6ec6b2e2b52a7d723e98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a74fe3123fab4a91b77674f6141448e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b8859634622e644a52ea5da886d0e4fdc301d4e083c7a6306199ec2a842bc3c599790f6fa8c8a9aee2d195a73ca44ba687ed83776a160600a05416e01b822313', 'id': '179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'created_at': datetime.datetime(2026, 9, 17, 22, 41, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 41, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb407d6-a091-4df4-8fcc-742410ee631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6eb407d6-a091-4df4-8fcc-742410ee631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495577e0-76e7-4f85-9b19-ea4a3d003e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:57 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Volume 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f', 'volume_size': 1, 'image_id': '179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db3935b3ce6e6ec6b2e2b52a7d723e98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a74fe3123fab4a91b77674f6141448e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b8859634622e644a52ea5da886d0e4fdc301d4e083c7a6306199ec2a842bc3c599790f6fa8c8a9aee2d195a73ca44ba687ed83776a160600a05416e01b822313', 'id': '179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'created_at': datetime.datetime(2026, 9, 17, 22, 41, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 41, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Trying to clone 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f from image 179e50d1-98c1-43f5-80fb-ff646d4c2a42 at location (None, [{'url': 'file:///opt/stack/data/glance/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:41:57 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Image download 0.00 MB at 0.00 MB/s Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73eb89c-fc8c-4978-b09c-b2a38377e400]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:57 devstack sudo[97388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD Sep 18 00:41:57 devstack sudo[97388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Flow 'volume_create_manager' (e03f59a7-4828-4815-9f38-5d817655696f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1ba91-b294-482b-bbc1-d645ab625574) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a7b1ba91-b294-482b-bbc1-d645ab625574) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1638412314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe9e20e-10d4-431b-aee0-95afbfb5094f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66848de2649c4a7fb35369957733b940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:41:58Z,use_quota=True,user_id='f4b756cb8a194bd7982ea5ef6025c36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedf9501-d38c-4f4d-9f23-183e9501fdab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cedf9501-d38c-4f4d-9f23-183e9501fdab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614dbe7e-c2c8-40bb-ade6-a9ebc5fe793d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (614dbe7e-c2c8-40bb-ade6-a9ebc5fe793d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2fe9e20e-10d4-431b-aee0-95afbfb5094f', 'volume_name': 'volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:57 devstack sudo[97388]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e604db-43a5-495f-a526-4fefc2d71e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45e604db-43a5-495f-a526-4fefc2d71e65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fe23c-e532-4bbb-8d8d-224efbf6a899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:57 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Volume 2fe9e20e-10d4-431b-aee0-95afbfb5094f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f', 'volume_size': 1} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:41:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1638412314',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2fe9e20e-10d4-431b-aee0-95afbfb5094f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66848de2649c4a7fb35369957733b940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:41:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:41:58Z,use_quota=True,user_id='f4b756cb8a194bd7982ea5ef6025c36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Creating volume 2fe9e20e-10d4-431b-aee0-95afbfb5094f {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:41:57 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD" returned: 0 in 0.491s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:57 devstack sudo[97392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f 1073741824 Sep 18 00:41:57 devstack sudo[97392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:58 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD Sep 18 00:41:58 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:58 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD" returned: 1 in 0.435s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Temporary image 179e50d1-98c1-43f5-80fb-ff646d4c2a42 is fetched for user 5aa81ce124404e8c94e7514ab56220f6. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f0322b7-18b2-4a7e-9ae1-47f37f8ead35]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:58 devstack sudo[97392]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f 1073741824" returned: 0 in 0.646s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:58 devstack sudo[97403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD Sep 18 00:41:58 devstack sudo[97403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:58 devstack sudo[97404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f Sep 18 00:41:58 devstack sudo[97404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:58 devstack sudo[97403]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD" returned: 0 in 0.438s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:58 devstack sudo[97404]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f" returned: 0 in 0.401s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.134s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a2fe23c-e532-4bbb-8d8d-224efbf6a899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:59 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD Sep 18 00:41:59 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead5d832-6ccb-43e8-a1b9-f004c61f9325) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:41:59 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Volume volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f (2fe9e20e-10d4-431b-aee0-95afbfb5094f): created successfully Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ead5d832-6ccb-43e8-a1b9-f004c61f9325) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Flow 'volume_create_manager' (e03f59a7-4828-4815-9f38-5d817655696f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:41:59 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6553560d-ff53-4dac-b673-3a487a8e41c0 tempest-AttachVolumeNegativeTest-1887761230 None] Created volume successfully. Sep 18 00:41:59 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD" returned: 1 in 0.537s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:41:56Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a74fe3123fab4a91b77674f6141448e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:41:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:41:56Z,use_quota=True,user_id='5aa81ce124404e8c94e7514ab56220f6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(83065534-f0fb-4a20-a1df-c63af1fb77b4),volume_type_id=83065534-f0fb-4a20-a1df-c63af1fb77b4)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Creating volume 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:41:59 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:41:59 devstack sudo[97415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f 1073741824 Sep 18 00:41:59 devstack sudo[97415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:41:59 devstack sudo[97415]: pam_unix(sudo:session): session closed for user root Sep 18 00:41:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f 1073741824" returned: 0 in 0.578s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:00 devstack sudo[97424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f Sep 18 00:42:00 devstack sudo[97424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:00 devstack sudo[97424]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f" returned: 0 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Attempting download of 179e50d1-98c1-43f5-80fb-ff646d4c2a42 ((None, [{'url': 'file:///opt/stack/data/glance/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'metadata': {}}])) to volume 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2eeee70c-3ddd-460b-8d37-cd69b28e5533]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_179e50d1-98c1-43f5-80fb-ff646d4c2a42_jchacif1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:00 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_179e50d1-98c1-43f5-80fb-ff646d4c2a42_jchacif1 Sep 18 00:42:00 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b1c80943-c827-4bb6-86ab-8332e0c12a9f req-5a99d4e8-91ba-4af0-8263-2e77c5c40ae6 tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b1c80943-c827-4bb6-86ab-8332e0c12a9f req-5a99d4e8-91ba-4af0-8263-2e77c5c40ae6 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-b1c80943-c827-4bb6-86ab-8332e0c12a9f req-5a99d4e8-91ba-4af0-8263-2e77c5c40ae6 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.033s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-b1c80943-c827-4bb6-86ab-8332e0c12a9f req-5a99d4e8-91ba-4af0-8263-2e77c5c40ae6 tempest-AttachVolumeNegativeTest-1887761230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '42869b3f-f3b6-4342-8fb3-cc67f523e08d', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:42:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b1c80943-c827-4bb6-86ab-8332e0c12a9f req-5a99d4e8-91ba-4af0-8263-2e77c5c40ae6 tempest-AttachVolumeNegativeTest-1887761230 None] attachment_update completed successfully. Sep 18 00:42:01 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_179e50d1-98c1-43f5-80fb-ff646d4c2a42_jchacif1" returned: 0 in 0.570s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179e50d1-98c1-43f5-80fb-ff646d4c2a42_jchacif1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:01 devstack sudo[97500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179e50d1-98c1-43f5-80fb-ff646d4c2a42_jchacif1 Sep 18 00:42:01 devstack sudo[97500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:01 devstack sudo[97500]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179e50d1-98c1-43f5-80fb-ff646d4c2a42_jchacif1" returned: 1 in 0.542s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_179e50d1-98c1-43f5-80fb-ff646d4c2a42_jchacif1' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:42:01 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[72ea068c-1bcb-4042-8e82-89be359c6eab]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:01 devstack sudo[97892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD Sep 18 00:42:01 devstack sudo[97892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:02 devstack sudo[97892]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:02 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD Sep 18 00:42:02 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:02 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD" returned: 1 in 0.347s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:42:02 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] 179e50d1-98c1-43f5-80fb-ff646d4c2a42 was raw, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:42:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:02 devstack sudo[97901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f Sep 18 00:42:02 devstack sudo[97901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:03 devstack sudo[97901]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f" returned: 0 in 0.694s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_179e50d1-98c1-43f5-80fb-ff646d4c2a42_h_08faapdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:42:03 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:03 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f 1G Sep 18 00:42:03 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:03 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f 1G" returned: 0 in 0.513s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Downloaded image 179e50d1-98c1-43f5-80fb-ff646d4c2a42 ((None, [{'url': 'file:///opt/stack/data/glance/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'metadata': {}}])) to volume 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Temporary image 179e50d1-98c1-43f5-80fb-ff646d4c2a42 for user 5aa81ce124404e8c94e7514ab56220f6 is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Marking volume 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Copying metadata from image 179e50d1-98c1-43f5-80fb-ff646d4c2a42 to 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Creating volume glance metadata for volume 67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f backed by image 179e50d1-98c1-43f5-80fb-ff646d4c2a42 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'db3935b3ce6e6ec6b2e2b52a7d723e98', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (495577e0-76e7-4f85-9b19-ea4a3d003e06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f', 'volume_size': 1, 'image_id': '179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'db3935b3ce6e6ec6b2e2b52a7d723e98', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a74fe3123fab4a91b77674f6141448e6', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b8859634622e644a52ea5da886d0e4fdc301d4e083c7a6306199ec2a842bc3c599790f6fa8c8a9aee2d195a73ca44ba687ed83776a160600a05416e01b822313', 'id': '179e50d1-98c1-43f5-80fb-ff646d4c2a42', 'created_at': datetime.datetime(2026, 9, 17, 22, 41, 54, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 41, 55, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/179e50d1-98c1-43f5-80fb-ff646d4c2a42/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4b9c7c-7a99-402d-bb05-5b0a223a136a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:03 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Volume volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f (67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f): created successfully Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b4b9c7c-7a99-402d-bb05-5b0a223a136a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:03 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Flow 'volume_create_manager' (6783138c-3fb9-4590-b0f2-ec7c5514242c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:03 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-afb7da83-be62-42ce-b053-18e90624f574 tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Created volume successfully. Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:04 devstack sudo[97913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:42:04 devstack sudo[97913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:04 devstack sudo[97913]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:42:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Acquiring lock "cinder-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "cinder-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Acquiring lock "cinder-quobyte-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "cinder-quobyte-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0b31856-49af-42f0-a105-05cf2baade9b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:05 devstack sudo[97916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f Sep 18 00:42:05 devstack sudo[97916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:05 devstack sudo[97916]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f" returned: 0 in 0.467s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:05 devstack sudo[97921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f Sep 18 00:42:05 devstack sudo[97921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:06 devstack sudo[97921]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f" returned: 0 in 0.353s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "cinder-quobyte-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f" released by "delete_volume" :: held 0.900s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:06 devstack cinder-volume[86526]: WARNING cinder.quota [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:42:06 devstack cinder-volume[86526]: WARNING cinder.quota [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Created reservations ['8ae9ee42-3010-4785-ac82-f96b3a87b423', 'befc9813-9669-400f-9758-cff916039398', '9cc75076-c21c-4d9f-8ef7-f4a66c32377a', '5672d652-51a3-4929-9683-0430d1851e23'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:06 devstack sudo[97924]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:42:06 devstack sudo[97924]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:06 devstack sudo[97924]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.502s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:42:06 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Deleted volume successfully. Sep 18 00:42:06 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29ce91ab-5d77-4094-9601-1f85b5fccbeb tempest-VolumeAndVolumeTypeFromImageTest-380994088 None] Lock "cinder-67ddfb3d-0c5a-4b41-bafb-c8e8a9c3b39f-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=100,cinder:UPDATE=91,cinder:INSERT=28,cinder:DELETE=6 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=95,cinder:UPDATE=87,cinder:DELETE=7,cinder:INSERT=26 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Flow 'volume_create_manager' (14edeccf-879a-4fe7-86e5-8e5730042d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473b4acb-4092-437f-8ec3-43d4e905f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (473b4acb-4092-437f-8ec3-43d4e905f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255715197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383a63f1-4b95-4952-bbff-4343512df30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be45c7c11b84446a04efa57a7acfcbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:16Z,use_quota=True,user_id='68cd5823a8404c2184a787c7eb1eeda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78f669e-423e-4ded-9672-edf1d9dcc328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a78f669e-423e-4ded-9672-edf1d9dcc328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a88a43-8b9b-45d5-a5b5-bd22906dc0d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6a88a43-8b9b-45d5-a5b5-bd22906dc0d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '383a63f1-4b95-4952-bbff-4343512df30b', 'volume_name': 'volume-383a63f1-4b95-4952-bbff-4343512df30b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8cc686-cfd2-4bfb-b7ed-5f91cf705f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6e8cc686-cfd2-4bfb-b7ed-5f91cf705f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e651e69-b6e3-47d1-a189-5d029cec0507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Volume 383a63f1-4b95-4952-bbff-4343512df30b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-383a63f1-4b95-4952-bbff-4343512df30b', 'volume_size': 1} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1255715197',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=383a63f1-4b95-4952-bbff-4343512df30b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be45c7c11b84446a04efa57a7acfcbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:16Z,use_quota=True,user_id='68cd5823a8404c2184a787c7eb1eeda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Creating volume 383a63f1-4b95-4952-bbff-4343512df30b {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.032s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:42:15 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:42:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:16 devstack sudo[97998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b 1073741824 Sep 18 00:42:16 devstack sudo[97998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:16 devstack sudo[97998]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b 1073741824" returned: 0 in 1.011s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:17 devstack sudo[98004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b Sep 18 00:42:17 devstack sudo[98004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:17 devstack sudo[98004]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b" returned: 0 in 0.617s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] <== create_volume: return (1811ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.828s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e651e69-b6e3-47d1-a189-5d029cec0507) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-383a63f1-4b95-4952-bbff-4343512df30b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef31a88-3d51-4601-a56d-9c3db7f3c071) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Volume volume-383a63f1-4b95-4952-bbff-4343512df30b (383a63f1-4b95-4952-bbff-4343512df30b): created successfully Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3ef31a88-3d51-4601-a56d-9c3db7f3c071) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Flow 'volume_create_manager' (14edeccf-879a-4fe7-86e5-8e5730042d5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Flow 'volume_create_manager' (1eb5b298-0314-4f88-9ef5-c97308f500a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480dca67-1623-424c-8314-be2772a5fc35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (480dca67-1623-424c-8314-be2772a5fc35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-88953312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33825775-2ae8-453b-ab43-123e46a711f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073571330c5e43b0a47f17b6442694c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:18Z,use_quota=True,user_id='fea74cebad5e4569a163ca84cb64e100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7f95fc-2c2e-471b-9980-8f962a65e88a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c7f95fc-2c2e-471b-9980-8f962a65e88a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42903050-02cf-4cde-9a4d-e08fabe87fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (42903050-02cf-4cde-9a4d-e08fabe87fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '33825775-2ae8-453b-ab43-123e46a711f1', 'volume_name': 'volume-33825775-2ae8-453b-ab43-123e46a711f1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910c196f-00b3-41ae-8118-de4995903054) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (910c196f-00b3-41ae-8118-de4995903054) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debbedcb-92c5-41a3-bc44-0779dfb13c7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Volume 33825775-2ae8-453b-ab43-123e46a711f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-33825775-2ae8-453b-ab43-123e46a711f1', 'volume_size': 1} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-88953312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=33825775-2ae8-453b-ab43-123e46a711f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='073571330c5e43b0a47f17b6442694c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:18Z,use_quota=True,user_id='fea74cebad5e4569a163ca84cb64e100',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Creating volume 33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:42:18 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-27a76852-031b-4553-8a7d-54209dc379df tempest-ProjectReaderTests-1730997720 None] Created volume successfully. Sep 18 00:42:18 devstack sudo[98007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 1073741824 Sep 18 00:42:18 devstack sudo[98007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:18 devstack sudo[98007]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 1073741824" returned: 0 in 0.738s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:18 devstack sudo[98013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 Sep 18 00:42:18 devstack sudo[98013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:19 devstack sudo[98013]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1" returned: 0 in 0.518s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] <== create_volume: return (1319ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (debbedcb-92c5-41a3-bc44-0779dfb13c7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-33825775-2ae8-453b-ab43-123e46a711f1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84aef94e-8f62-4772-8a52-ff5bb2f01c35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Acquiring lock "cinder-383a63f1-4b95-4952-bbff-4343512df30b-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Volume volume-33825775-2ae8-453b-ab43-123e46a711f1 (33825775-2ae8-453b-ab43-123e46a711f1): created successfully Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84aef94e-8f62-4772-8a52-ff5bb2f01c35) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Flow 'volume_create_manager' (1eb5b298-0314-4f88-9ef5-c97308f500a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Lock "cinder-383a63f1-4b95-4952-bbff-4343512df30b-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0e775cb8-c270-4350-b140-60b8dd4ccdf0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Created volume successfully. Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Acquiring lock "cinder-quobyte-383a63f1-4b95-4952-bbff-4343512df30b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Lock "cinder-quobyte-383a63f1-4b95-4952-bbff-4343512df30b" acquired by "delete_volume" :: waited 0.040s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ce6d533-eab3-408a-aba1-99c46c4bac51]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:20 devstack sudo[98016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b Sep 18 00:42:20 devstack sudo[98016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Creating offline snapshot 774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe of volume 33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e47fd1ee-a2d1-41c3-9896-e8194feedab9]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:20 devstack sudo[98020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 Sep 18 00:42:20 devstack sudo[98020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:20 devstack sudo[98016]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b" returned: 0 in 0.800s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:20 devstack sudo[98026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b Sep 18 00:42:20 devstack sudo[98026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:20 devstack sudo[98020]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1" returned: 0 in 0.688s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:20 devstack sudo[98026]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-383a63f1-4b95-4952-bbff-4343512df30b" returned: 0 in 0.415s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:20 devstack sudo[98032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe 1G Sep 18 00:42:20 devstack sudo[98032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Lock "cinder-quobyte-383a63f1-4b95-4952-bbff-4343512df30b" released by "delete_volume" :: held 1.380s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Created reservations ['f2254cb1-4280-45ae-9589-9845ecdf7158', 'd19e42da-b4e9-4e97-9a8a-6b16851c2007', '2c21db8a-e5a1-4a83-a7b8-85330189227d', 'caa64559-a460-496b-a998-b46776ae7026'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:21 devstack sudo[98061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:42:21 devstack sudo[98061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:21 devstack sudo[98032]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe 1G" returned: 0 in 0.699s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33825775-2ae8-453b-ab43-123e46a711f1 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:21 devstack sudo[98061]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:42:21 devstack sudo[98066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33825775-2ae8-453b-ab43-123e46a711f1 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe Sep 18 00:42:21 devstack sudo[98066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Deleted volume successfully. Sep 18 00:42:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-99be90a7-ccea-45b9-9bb0-e1237739b60f tempest-ProjectReaderTests-1730997720 None] Lock "cinder-383a63f1-4b95-4952-bbff-4343512df30b-delete_volume" released by "delete_volume" :: held 2.293s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:22 devstack sudo[98066]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-33825775-2ae8-453b-ab43-123e46a711f1 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" returned: 0 in 0.673s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:22 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe is being set with open permissions: ugo+rw Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:22 devstack sudo[98072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe Sep 18 00:42:22 devstack sudo[98072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:42:22 devstack sudo[98072]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Flow 'volume_create_manager' (b28ef468-b560-479a-b589-926db04cf441) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307367d2-ce1c-4b3e-8c5e-54784ead3217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" returned: 0 in 0.605s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (307367d2-ce1c-4b3e-8c5e-54784ead3217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208125453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a681398-bcb5-4b7e-a6a1-da350480e9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be45c7c11b84446a04efa57a7acfcbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:23Z,use_quota=True,user_id='68cd5823a8404c2184a787c7eb1eeda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798f4ea9-c775-466b-99f6-4d8ffb62ce1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (798f4ea9-c775-466b-99f6-4d8ffb62ce1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b690f32b-374f-4811-8926-47775f122178) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b690f32b-374f-4811-8926-47775f122178) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2a681398-bcb5-4b7e-a6a1-da350480e9f9', 'volume_name': 'volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12dd3c8-cc96-4c5c-b637-0322ede76625) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f12dd3c8-cc96-4c5c-b637-0322ede76625) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83463ff2-fb4b-4c88-b40c-6a3c5a32a724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Volume 2a681398-bcb5-4b7e-a6a1-da350480e9f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9', 'volume_size': 1} Sep 18 00:42:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:23 devstack sudo[98075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.info Sep 18 00:42:23 devstack sudo[98075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:23 devstack sudo[98075]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.info" returned: 0 in 0.422s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:23 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.info is being set with open permissions: ugo+rw Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:23 devstack sudo[98078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.info Sep 18 00:42:23 devstack sudo[98078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:23 devstack sudo[98078]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.info" returned: 0 in 0.487s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.809s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.994s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-208125453',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2a681398-bcb5-4b7e-a6a1-da350480e9f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3be45c7c11b84446a04efa57a7acfcbf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:23Z,use_quota=True,user_id='68cd5823a8404c2184a787c7eb1eeda7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Creating volume 2a681398-bcb5-4b7e-a6a1-da350480e9f9 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:42:24 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:42:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:24 devstack sudo[98081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 1073741824 Sep 18 00:42:24 devstack sudo[98081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-275f5726-3fee-46c9-a1f6-7f964a2a811b tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Create snapshot completed successfully Sep 18 00:42:24 devstack sudo[98081]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 1073741824" returned: 0 in 0.794s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:24 devstack sudo[98088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 Sep 18 00:42:24 devstack sudo[98088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "cinder-774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "cinder-quobyte-33825775-2ae8-453b-ab43-123e46a711f1" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-quobyte-33825775-2ae8-453b-ab43-123e46a711f1" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "cinder-quobyte-774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-quobyte-774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Deleting offline snapshot 774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe of volume 33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:42:25 devstack sudo[98088]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] snapshot_file for this snap is: volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9" returned: 0 in 0.602s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] <== create_volume: return (1505ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.510s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8ec0af4-7569-420c-85b8-29f59bc258a6]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83463ff2-fb4b-4c88-b40c-6a3c5a32a724) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3757f047-b36b-4a1c-b159-304a89b04f91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Volume volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 (2a681398-bcb5-4b7e-a6a1-da350480e9f9): created successfully Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3757f047-b36b-4a1c-b159-304a89b04f91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Flow 'volume_create_manager' (b28ef468-b560-479a-b589-926db04cf441) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fe425627-4387-4380-b85a-23015abd9510 tempest-ProjectReaderTests-1730997720 None] Created volume successfully. Sep 18 00:42:25 devstack sudo[98091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe Sep 18 00:42:25 devstack sudo[98091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Acquiring lock "cinder-2a681398-bcb5-4b7e-a6a1-da350480e9f9-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Lock "cinder-2a681398-bcb5-4b7e-a6a1-da350480e9f9-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Acquiring lock "cinder-quobyte-2a681398-bcb5-4b7e-a6a1-da350480e9f9" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Lock "cinder-quobyte-2a681398-bcb5-4b7e-a6a1-da350480e9f9" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:26 devstack sudo[98091]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" returned: 0 in 0.841s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-33825775-2ae8-453b-ab43-123e46a711f1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e446bcce-171d-439b-9916-3783e41f2643]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c98da1c4-073e-4b39-aabf-ed144dc4d79b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:26 devstack sudo[98096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 Sep 18 00:42:26 devstack sudo[98096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:26 devstack sudo[98097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 Sep 18 00:42:26 devstack sudo[98097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:26 devstack sudo[98096]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9" returned: 0 in 0.538s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:26 devstack sudo[98107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9 Sep 18 00:42:26 devstack sudo[98107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:26 devstack sudo[98097]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1" returned: 0 in 0.589s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:27 devstack sudo[98110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe Sep 18 00:42:27 devstack sudo[98110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:27 devstack sudo[98107]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2a681398-bcb5-4b7e-a6a1-da350480e9f9" returned: 0 in 0.403s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Lock "cinder-quobyte-2a681398-bcb5-4b7e-a6a1-da350480e9f9" released by "delete_volume" :: held 1.020s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Created reservations ['1ec6131f-abd0-4e6c-a99e-d8af8b48ce43', 'cf002af9-ea97-439f-af38-cd5f028aac26', 'c3d2bc32-d96e-4a38-afc8-19fa153c0b88', 'ad84e98b-b428-43b8-9723-d11dddbd8f77'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:27 devstack sudo[98110]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" returned: 0 in 0.652s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:27 devstack sudo[98116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:42:27 devstack sudo[98116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:27 devstack sudo[98117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe Sep 18 00:42:27 devstack sudo[98117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:27 devstack sudo[98116]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.353s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:27 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:42:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Deleted volume successfully. Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-62ec094e-b861-4802-b644-00f4cae9ecb1 tempest-ProjectReaderTests-1730997720 None] Lock "cinder-2a681398-bcb5-4b7e-a6a1-da350480e9f9-delete_volume" released by "delete_volume" :: held 1.782s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:28 devstack sudo[98117]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1.774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" returned: 0 in 0.398s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-quobyte-774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe" released by "_delete_snapshot" :: held 2.644s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-quobyte-33825775-2ae8-453b-ab43-123e46a711f1" released by "delete_snapshot" :: held 2.678s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Created reservations ['93211c2e-77bb-40a3-a35e-e14171ef32e1', 'b644b2eb-09e8-4a5b-931d-cc8d0dac3a1d', '9e23cd96-27b1-4b78-9065-5da3d76a93fb', '2a9d095e-4bc8-4af5-9b30-8bcdba93bbcf'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:42:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Delete snapshot completed successfully. Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-34ae23a9-0897-4b48-8ef9-5dae4c2d94c0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-774dc7ce-4b7e-4609-ad0d-dcd5db85fbfe-delete_snapshot" released by "delete_snapshot" :: held 2.829s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "cinder-33825775-2ae8-453b-ab43-123e46a711f1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-33825775-2ae8-453b-ab43-123e46a711f1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "cinder-quobyte-33825775-2ae8-453b-ab43-123e46a711f1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-quobyte-33825775-2ae8-453b-ab43-123e46a711f1" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b583a297-189d-46c8-8ae6-bb99f428aca4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:29 devstack sudo[98137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 Sep 18 00:42:29 devstack sudo[98137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Flow 'volume_create_manager' (55f2dbcc-b93e-4d8b-930c-cfc9133b2fb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ead5a0e-9fbb-4b1e-8100-54835aabf79b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6ead5a0e-9fbb-4b1e-8100-54835aabf79b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1269183503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40defa1-b710-4255-9a12-8d4022c044b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7beb2cdd65644dbb85117e3cafcd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:29Z,use_quota=True,user_id='8f5abdca0bbf4bc8a0e48545171f4f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6589051d-5eba-4ccb-bcaa-abce988397f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6589051d-5eba-4ccb-bcaa-abce988397f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ee9897-10c8-4a61-a416-8eaa0fe227b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:42:29 devstack sudo[98137]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1" returned: 0 in 0.429s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:29 devstack sudo[98142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1 Sep 18 00:42:29 devstack sudo[98142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:29 devstack sudo[98142]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-33825775-2ae8-453b-ab43-123e46a711f1" returned: 0 in 0.288s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22ee9897-10c8-4a61-a416-8eaa0fe227b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c40defa1-b710-4255-9a12-8d4022c044b4', 'volume_name': 'volume-c40defa1-b710-4255-9a12-8d4022c044b4', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdb41fd-035f-4f19-9656-c55f94dcea26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cdb41fd-035f-4f19-9656-c55f94dcea26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdda619-69a1-4c33-a6b2-d38bc4b7c0cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:29 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Volume c40defa1-b710-4255-9a12-8d4022c044b4: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c40defa1-b710-4255-9a12-8d4022c044b4', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Trying to clone c40defa1-b710-4255-9a12-8d4022c044b4 from image 08c75831-54cd-415b-93ab-76883c9da538 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-quobyte-33825775-2ae8-453b-ab43-123e46a711f1" released by "delete_volume" :: held 0.860s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:29 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Created reservations ['58c5ba76-301e-4890-8c55-afffa55945d0', '69adb8d6-dc27-4233-90c3-cf83a33634d4', '7c86f22c-6ed0-42c7-a152-9072de19bd01', '602f56cd-3d0c-4673-9b82-ead298299d8c'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:30 devstack sudo[98145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:42:30 devstack sudo[98145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:42:30 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Image download 20.69 MB at 20.69 MB/s Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[40506068-460f-4694-a9e3-50d4c6ffd1f0]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:30 devstack sudo[98145]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.318s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:42:30 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Deleted volume successfully. Sep 18 00:42:30 devstack sudo[98148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD Sep 18 00:42:30 devstack sudo[98148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f3cfe815-6e19-4725-9086-18b0c7c73203 tempest-VolumeSnapshotQuotasNegativeTestJSON-1067892423 None] Lock "cinder-33825775-2ae8-453b-ab43-123e46a711f1-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:30 devstack sudo[98148]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 is fetched for user 8f5abdca0bbf4bc8a0e48545171f4f8e. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee69548a-70ea-4f05-8499-52241986e274]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:30 devstack sudo[98155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD Sep 18 00:42:30 devstack sudo[98155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:31 devstack sudo[98155]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1269183503',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c40defa1-b710-4255-9a12-8d4022c044b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7beb2cdd65644dbb85117e3cafcd041',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:29Z,use_quota=True,user_id='8f5abdca0bbf4bc8a0e48545171f4f8e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Creating volume c40defa1-b710-4255-9a12-8d4022c044b4 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:42:31 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:31 devstack sudo[98162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 1073741824 Sep 18 00:42:31 devstack sudo[98162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:31 devstack sudo[98162]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 1073741824" returned: 0 in 0.512s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:31 devstack sudo[98168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 Sep 18 00:42:31 devstack sudo[98168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:31 devstack sudo[98168]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4" returned: 0 in 0.286s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:42:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Attempting download of 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume c40defa1-b710-4255-9a12-8d4022c044b4. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c834bdf9-58c1-4d3e-8e6f-88eeeef900d1]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_d7_sgy19 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:32 devstack sudo[98171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_d7_sgy19 Sep 18 00:42:32 devstack sudo[98171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:32 devstack sudo[98171]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_d7_sgy19" returned: 0 in 0.342s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_d7_sgy19 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:32 devstack sudo[98175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_d7_sgy19 Sep 18 00:42:32 devstack sudo[98175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:32 devstack sudo[98175]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_d7_sgy19" returned: 1 in 0.345s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_d7_sgy19' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd8fb82d-441a-4b21-bf82-b17e17dbe6c9]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:32 devstack sudo[98179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD Sep 18 00:42:32 devstack sudo[98179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:33 devstack sudo[98179]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD" returned: 0 in 0.367s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:33 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] 08c75831-54cd-415b-93ab-76883c9da538 was qcow2, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:42:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:33 devstack sudo[98184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 Sep 18 00:42:33 devstack sudo[98184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:35 devstack sudo[98184]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4" returned: 0 in 2.516s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:35 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_ryhmtv5gdevstack@QuobyteHD, size 112.00 MB, duration 2.52 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:42:35 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Converted 112.00 MB image at 44.49 MB/s Sep 18 00:42:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:35 devstack sudo[98191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 1G Sep 18 00:42:35 devstack sudo[98191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:36 devstack sudo[98191]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 1G" returned: 0 in 0.481s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Downloaded image 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume c40defa1-b710-4255-9a12-8d4022c044b4 successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 for user 8f5abdca0bbf4bc8a0e48545171f4f8e is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Marking volume c40defa1-b710-4255-9a12-8d4022c044b4 as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Copying metadata from image 08c75831-54cd-415b-93ab-76883c9da538 to c40defa1-b710-4255-9a12-8d4022c044b4. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Creating volume glance metadata for volume c40defa1-b710-4255-9a12-8d4022c044b4 backed by image 08c75831-54cd-415b-93ab-76883c9da538 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bdda619-69a1-4c33-a6b2-d38bc4b7c0cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c40defa1-b710-4255-9a12-8d4022c044b4', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc052a62-6786-4f46-a466-25b7649aefbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:36 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Volume volume-c40defa1-b710-4255-9a12-8d4022c044b4 (c40defa1-b710-4255-9a12-8d4022c044b4): created successfully Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc052a62-6786-4f46-a466-25b7649aefbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Flow 'volume_create_manager' (55f2dbcc-b93e-4d8b-930c-cfc9133b2fb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-90efe887-5047-4647-b1f4-44524ffa70d5 tempest-TestShelveInstance-1941620317 None] Created volume successfully. Sep 18 00:42:37 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Flow 'volume_create_manager' (732469cf-dcb9-4880-a00d-4d4075464068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f21b89-6518-4dc3-9736-8fb4c7d4b158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d3f21b89-6518-4dc3-9736-8fb4c7d4b158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-834575771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f869cf42-a0ae-451c-8d6b-98a9877a7b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d95ca91b15d416dbd33cf3a94b7a54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:38Z,use_quota=True,user_id='60c582ef74b5441bab9fabd06032657f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7ab481-676f-4730-bbd0-a3e361babb14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec7ab481-676f-4730-bbd0-a3e361babb14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2868dfde-9d4a-4d5d-bdb6-79ac64b4d3a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2868dfde-9d4a-4d5d-bdb6-79ac64b4d3a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f869cf42-a0ae-451c-8d6b-98a9877a7b93', 'volume_name': 'volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51097c0-d914-4654-939d-38eb60780e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c51097c0-d914-4654-939d-38eb60780e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb21960-92ec-4e24-8259-524c6d92b14a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:38 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Volume f869cf42-a0ae-451c-8d6b-98a9877a7b93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93', 'volume_size': 1} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:42:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-834575771',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f869cf42-a0ae-451c-8d6b-98a9877a7b93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9d95ca91b15d416dbd33cf3a94b7a54f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:42:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:42:38Z,use_quota=True,user_id='60c582ef74b5441bab9fabd06032657f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Creating volume f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:42:38 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:38 devstack sudo[98201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 1073741824 Sep 18 00:42:38 devstack sudo[98201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:38 devstack sudo[98201]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 1073741824" returned: 0 in 0.589s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:38 devstack sudo[98214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 Sep 18 00:42:38 devstack sudo[98214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:39 devstack sudo[98214]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93" returned: 0 in 0.440s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] <== create_volume: return (1095ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:42:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.099s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8bb21960-92ec-4e24-8259-524c6d92b14a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3008d9-131e-4b9f-a72d-c1676c6b9121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:42:39 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Volume volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 (f869cf42-a0ae-451c-8d6b-98a9877a7b93): created successfully Sep 18 00:42:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ce3008d9-131e-4b9f-a72d-c1676c6b9121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:42:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Flow 'volume_create_manager' (732469cf-dcb9-4880-a00d-4d4075464068) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:42:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-26475f78-8ec0-4efb-85e6-cd3087938296 tempest-SnapshotMetadataTestJSON-898972075 None] Created volume successfully. Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Creating offline snapshot 856d457b-589c-4850-8379-f46c8424b8b8 of volume f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[abead26f-d352-41ed-8570-b90279802cf1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-ea06b500-251e-40d7-85b3-b8acf8a5de31 req-579e2625-0369-4d40-9f20-79ed139fad6c tempest-TestShelveInstance-1941620317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:40 devstack sudo[98251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 Sep 18 00:42:40 devstack sudo[98251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:40 devstack sudo[98251]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93" returned: 0 in 0.448s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:40 devstack sudo[98259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 1G Sep 18 00:42:40 devstack sudo[98259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:41 devstack sudo[98259]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 1G" returned: 0 in 0.557s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:41 devstack sudo[98267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 Sep 18 00:42:41 devstack sudo[98267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:41 devstack sudo[98267]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8" returned: 0 in 0.375s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:41 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 is being set with open permissions: ugo+rw Sep 18 00:42:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:41 devstack sudo[98272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 Sep 18 00:42:41 devstack sudo[98272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:42 devstack sudo[98272]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8" returned: 0 in 0.408s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:42 devstack sudo[98275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.info Sep 18 00:42:42 devstack sudo[98275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:42 devstack sudo[98275]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.info" returned: 0 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:42 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.info is being set with open permissions: ugo+rw Sep 18 00:42:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:42 devstack sudo[98278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.info Sep 18 00:42:42 devstack sudo[98278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:43 devstack sudo[98278]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.info" returned: 0 in 0.309s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.643s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-ea06b500-251e-40d7-85b3-b8acf8a5de31 req-579e2625-0369-4d40-9f20-79ed139fad6c tempest-TestShelveInstance-1941620317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 2.546s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-ea06b500-251e-40d7-85b3-b8acf8a5de31 req-579e2625-0369-4d40-9f20-79ed139fad6c tempest-TestShelveInstance-1941620317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3302b5e8-7c13-416e-96c4-43cc5d0f44eb tempest-SnapshotMetadataTestJSON-898972075 None] Create snapshot completed successfully Sep 18 00:42:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-ea06b500-251e-40d7-85b3-b8acf8a5de31 req-579e2625-0369-4d40-9f20-79ed139fad6c tempest-TestShelveInstance-1941620317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-c40defa1-b710-4255-9a12-8d4022c044b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'fb2f4ae0-c383-4d7e-b8a1-a1b034daf7a4', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:42:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-ea06b500-251e-40d7-85b3-b8acf8a5de31 req-579e2625-0369-4d40-9f20-79ed139fad6c tempest-TestShelveInstance-1941620317 None] attachment_update completed successfully. Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "cinder-856d457b-589c-4850-8379-f46c8424b8b8-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-856d457b-589c-4850-8379-f46c8424b8b8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "cinder-quobyte-f869cf42-a0ae-451c-8d6b-98a9877a7b93" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-quobyte-f869cf42-a0ae-451c-8d6b-98a9877a7b93" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "cinder-quobyte-856d457b-589c-4850-8379-f46c8424b8b8" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-quobyte-856d457b-589c-4850-8379-f46c8424b8b8" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Deleting offline snapshot 856d457b-589c-4850-8379-f46c8424b8b8 of volume f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] snapshot_file for this snap is: volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f0f954-a6e1-4847-b6f1-486639a68b76]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:44 devstack sudo[98281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 Sep 18 00:42:44 devstack sudo[98281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:45 devstack sudo[98281]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8" returned: 0 in 0.465s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:42:45 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc84f29b-6d48-4ed6-8410-b2f55ae83481]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:45 devstack sudo[98286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 Sep 18 00:42:45 devstack sudo[98286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:45 devstack sudo[98286]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93" returned: 0 in 0.496s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:45 devstack sudo[98291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 Sep 18 00:42:45 devstack sudo[98291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:46 devstack sudo[98291]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8" returned: 0 in 0.439s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:46 devstack sudo[98298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8 Sep 18 00:42:46 devstack sudo[98298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:46 devstack sudo[98298]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93.856d457b-589c-4850-8379-f46c8424b8b8" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-quobyte-856d457b-589c-4850-8379-f46c8424b8b8" released by "_delete_snapshot" :: held 1.839s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-quobyte-f869cf42-a0ae-451c-8d6b-98a9877a7b93" released by "delete_snapshot" :: held 1.872s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:46 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Created reservations ['4e9f3073-0af6-45d6-846a-db2bbeb2fd14', '3570b108-fd4f-463f-8ae4-cbe3f70885c0', 'f7654f02-d8be-430a-a34c-a54489890e2b', '4a068854-3614-4e75-aec4-c28245c2edac'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:42:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Delete snapshot completed successfully. Sep 18 00:42:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8f8cb386-9824-4de9-8c9e-696f75d0aca0 tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-856d457b-589c-4850-8379-f46c8424b8b8-delete_snapshot" released by "delete_snapshot" :: held 2.035s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "cinder-f869cf42-a0ae-451c-8d6b-98a9877a7b93-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-f869cf42-a0ae-451c-8d6b-98a9877a7b93-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "cinder-quobyte-f869cf42-a0ae-451c-8d6b-98a9877a7b93" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-quobyte-f869cf42-a0ae-451c-8d6b-98a9877a7b93" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c10c036-ff41-469e-9ce6-58ee21d6fc3a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:47 devstack sudo[98302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 Sep 18 00:42:47 devstack sudo[98302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:47 devstack sudo[98302]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93" returned: 0 in 0.708s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:48 devstack sudo[98314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93 Sep 18 00:42:48 devstack sudo[98314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-c915f5b0-0462-47fd-8a40-9e11def21b24 req-f755a02a-9466-420b-bf10-8b38975a8618 tempest-AttachVolumeNegativeTest-1887761230 None] Terminate volume connection completed successfully. Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-c915f5b0-0462-47fd-8a40-9e11def21b24 req-f755a02a-9466-420b-bf10-8b38975a8618 tempest-AttachVolumeNegativeTest-1887761230 None] Deleting attachment 42869b3f-f3b6-4342-8fb3-cc67f523e08d. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:42:48 devstack sudo[98314]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f869cf42-a0ae-451c-8d6b-98a9877a7b93" returned: 0 in 0.577s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-quobyte-f869cf42-a0ae-451c-8d6b-98a9877a7b93" released by "delete_volume" :: held 1.424s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Created reservations ['fe58ee8b-96c3-41e1-960a-fd06e8c1d788', '81fe49ca-ab2f-4a89-a419-033bbed92a03', 'f1e54c61-e199-489a-99e8-5c9a68ec2c23', 'b6686ee1-5329-4ecf-851c-dcadc40789f5'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:42:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:42:48 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:42:48 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:42:49 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 18 00:42:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.646s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:42:49 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:42:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Deleted volume successfully. Sep 18 00:42:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9949cb4b-8e74-4daf-b43b-70c034d3ec1e tempest-SnapshotMetadataTestJSON-898972075 None] Lock "cinder-f869cf42-a0ae-451c-8d6b-98a9877a7b93-delete_volume" released by "delete_volume" :: held 2.472s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:42:58 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=56,cinder:INSERT=21,cinder:UPDATE=73,cinder:DELETE=4 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:42:59 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=69,cinder:UPDATE=54,cinder:INSERT=23,cinder:DELETE=7 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Flow 'volume_create_manager' (95ac7927-0843-4673-95b4-286f1cb6640f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6448c44e-e3c0-4a15-a7e6-498be38657ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6448c44e-e3c0-4a15-a7e6-498be38657ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1668046920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a252fa-bc26-4e1f-9e68-88b0d9e32be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cec389402d45a095de0b8d8ced7b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:01Z,use_quota=True,user_id='f0ad411bb064458ba737fbb2d601e5a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94587c4-517b-458f-925e-3c4d66b84401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a94587c4-517b-458f-925e-3c4d66b84401) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5571326b-d73a-4b57-99da-2638a4c47189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5571326b-d73a-4b57-99da-2638a4c47189) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4a252fa-bc26-4e1f-9e68-88b0d9e32be5', 'volume_name': 'volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925c468c-cb8d-4497-9b34-bfd4ed7d2ab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (925c468c-cb8d-4497-9b34-bfd4ed7d2ab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbfe730-4824-48e4-a1af-140bd8d7554f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:01 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Volume b4a252fa-bc26-4e1f-9e68-88b0d9e32be5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5', 'volume_size': 1} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1668046920',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4a252fa-bc26-4e1f-9e68-88b0d9e32be5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cec389402d45a095de0b8d8ced7b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:01Z,use_quota=True,user_id='f0ad411bb064458ba737fbb2d601e5a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Creating volume b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:43:01 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:01 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 1073741824 Sep 18 00:43:01 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:01 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 1073741824" returned: 0 in 0.646s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:02 devstack sudo[98865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 Sep 18 00:43:02 devstack sudo[98865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:02 devstack sudo[98865]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5" returned: 0 in 0.543s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] <== create_volume: return (1326ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:43:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.328s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fbfe730-4824-48e4-a1af-140bd8d7554f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc8638f-ca75-41d3-9d97-47a7b326e974) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:02 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Volume volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 (b4a252fa-bc26-4e1f-9e68-88b0d9e32be5): created successfully Sep 18 00:43:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7bc8638f-ca75-41d3-9d97-47a7b326e974) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Flow 'volume_create_manager' (95ac7927-0843-4673-95b4-286f1cb6640f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:02 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fd116a74-4e61-4ca8-ba78-93f4f0d1d0cc tempest-VolumesTransfersV355Test-1652442389 None] Created volume successfully. Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:04 devstack sudo[98871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:43:04 devstack sudo[98871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:04 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9d91efdd-b11a-4cac-9faa-7e7312532ce8 tempest-VolumesTransfersV355Test-1721397719 None] Transfer volume completed successfully. Sep 18 00:43:04 devstack sudo[98871]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.521s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:43:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:43:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Acquiring lock "cinder-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:06 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Acquiring lock "cinder-quobyte-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:06 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-quobyte-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5" acquired by "delete_volume" :: waited 0.035s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:06 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bacba5b-5fcd-4e9f-ac2c-45c90061539e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:06 devstack sudo[98874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 Sep 18 00:43:06 devstack sudo[98874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:06 devstack sudo[98874]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5" returned: 0 in 0.565s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:06 devstack sudo[98879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5 Sep 18 00:43:06 devstack sudo[98879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Flow 'volume_create_manager' (0ecc639b-4016-4db1-8810-5e16a6f2c5c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c1a740-e5d5-424c-8e6f-ae51e7699cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53c1a740-e5d5-424c-8e6f-ae51e7699cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1456250464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4408ffee-96a7-4500-bbb1-0748c50f327a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda05729afe7470e9c228e1668401a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:07Z,use_quota=True,user_id='049c5044abec41d9b94b28d575114f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e598bbc-aa7d-42ba-8d83-fc2b6578ca80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e598bbc-aa7d-42ba-8d83-fc2b6578ca80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c345c8f-ae66-44dc-b315-7fd70ba582ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c345c8f-ae66-44dc-b315-7fd70ba582ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4408ffee-96a7-4500-bbb1-0748c50f327a', 'volume_name': 'volume-4408ffee-96a7-4500-bbb1-0748c50f327a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d8b02c-cf72-483c-8f0b-6a0c1630dedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9d8b02c-cf72-483c-8f0b-6a0c1630dedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69848a29-52b0-4f16-b93e-fb5a205bc6a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Volume 4408ffee-96a7-4500-bbb1-0748c50f327a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4408ffee-96a7-4500-bbb1-0748c50f327a', 'volume_size': 1} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1456250464',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4408ffee-96a7-4500-bbb1-0748c50f327a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda05729afe7470e9c228e1668401a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:07Z,use_quota=True,user_id='049c5044abec41d9b94b28d575114f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Creating volume 4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:07 devstack sudo[98879]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:43:07 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5" returned: 0 in 0.490s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-quobyte-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5" released by "delete_volume" :: held 1.114s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:07 devstack sudo[98882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a 1073741824 Sep 18 00:43:07 devstack sudo[98882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Created reservations ['e722dc16-112f-46b4-b36a-40bfc77614c0', '8abad3b8-9801-48b2-9964-ce2bd5112009', 'e67acf20-f6fe-47fa-8897-f73f7b3db7cc', '60fedbeb-927c-486c-9096-ce9fd8dad025'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:07 devstack sudo[98884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:43:07 devstack sudo[98884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:07 devstack sudo[98884]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.299s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:43:07 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Deleted volume successfully. Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0010afc-bdf7-4848-a622-bb1884ec1106 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-b4a252fa-bc26-4e1f-9e68-88b0d9e32be5-delete_volume" released by "delete_volume" :: held 1.786s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:07 devstack sudo[98882]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a 1073741824" returned: 0 in 0.577s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:07 devstack sudo[98892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a Sep 18 00:43:07 devstack sudo[98892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:08 devstack sudo[98892]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a" returned: 0 in 0.296s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (69848a29-52b0-4f16-b93e-fb5a205bc6a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4408ffee-96a7-4500-bbb1-0748c50f327a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45615175-92b4-4366-9185-f77344687997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:08 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Volume volume-4408ffee-96a7-4500-bbb1-0748c50f327a (4408ffee-96a7-4500-bbb1-0748c50f327a): created successfully Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (45615175-92b4-4366-9185-f77344687997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Flow 'volume_create_manager' (0ecc639b-4016-4db1-8810-5e16a6f2c5c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:08 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-47d9f919-8f9a-433d-a589-9195b3e55563 tempest-SnapshotDependencyTests-125521678 None] Created volume successfully. Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Flow 'volume_create_manager' (73411130-278f-4cf1-9106-32fc84d983a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf964f5d-db63-4810-beef-94041394d22a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf964f5d-db63-4810-beef-94041394d22a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-246735259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b9b5fb-0d57-4e93-b247-0b9c96a7b55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cec389402d45a095de0b8d8ced7b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:09Z,use_quota=True,user_id='f0ad411bb064458ba737fbb2d601e5a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90698c72-a74a-489a-81c3-8b7d4c100a2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90698c72-a74a-489a-81c3-8b7d4c100a2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ffd4f1-8c43-4820-ab97-fd4777b36151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29ffd4f1-8c43-4820-ab97-fd4777b36151) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '73b9b5fb-0d57-4e93-b247-0b9c96a7b55c', 'volume_name': 'volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cbf3c4-2670-4c07-8aca-5266026687d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (62cbf3c4-2670-4c07-8aca-5266026687d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96ad92c-c861-41f3-be6d-fb4a4e622e3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:08 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Volume 73b9b5fb-0d57-4e93-b247-0b9c96a7b55c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c', 'volume_size': 1} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-246735259',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73b9b5fb-0d57-4e93-b247-0b9c96a7b55c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='38cec389402d45a095de0b8d8ced7b3f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:09Z,use_quota=True,user_id='f0ad411bb064458ba737fbb2d601e5a3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Creating volume 73b9b5fb-0d57-4e93-b247-0b9c96a7b55c {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:43:08 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:43:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:09 devstack sudo[98898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c 1073741824 Sep 18 00:43:09 devstack sudo[98898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:09 devstack sudo[98898]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c 1073741824" returned: 0 in 0.618s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:09 devstack sudo[98928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c Sep 18 00:43:09 devstack sudo[98928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:10 devstack sudo[98928]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.477s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d96ad92c-c861-41f3-be6d-fb4a4e622e3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cc20b1-7c73-423a-aebe-2f2af5e360a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Creating offline snapshot a17894d1-203a-42bc-b6fe-b86bd1195572 of volume 4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:43:10 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Volume volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c (73b9b5fb-0d57-4e93-b247-0b9c96a7b55c): created successfully Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (16cc20b1-7c73-423a-aebe-2f2af5e360a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Flow 'volume_create_manager' (73411130-278f-4cf1-9106-32fc84d983a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f2b4632-c378-4807-a10a-05cac6918f4a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:10 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-271726ca-ace6-471f-966d-077be41b94dc tempest-VolumesTransfersV355Test-1652442389 None] Created volume successfully. Sep 18 00:43:10 devstack sudo[98931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a Sep 18 00:43:10 devstack sudo[98931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:10 devstack sudo[98931]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a" returned: 0 in 0.513s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:10 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 1G Sep 18 00:43:10 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:11 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 1G" returned: 0 in 0.778s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4408ffee-96a7-4500-bbb1-0748c50f327a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:11 devstack sudo[98957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4408ffee-96a7-4500-bbb1-0748c50f327a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 Sep 18 00:43:11 devstack sudo[98957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Acquiring lock "cinder-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Acquiring lock "cinder-quobyte-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-quobyte-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c" acquired by "delete_volume" :: waited 0.051s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfda8755-ef30-4ccf-8e8e-2aa7450c9958]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:11 devstack sudo[98957]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4408ffee-96a7-4500-bbb1-0748c50f327a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572" returned: 0 in 0.570s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:11 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 is being set with open permissions: ugo+rw Sep 18 00:43:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:12 devstack sudo[98973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 Sep 18 00:43:12 devstack sudo[98973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:12 devstack sudo[98972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c Sep 18 00:43:12 devstack sudo[98972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:12 devstack sudo[98973]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572" returned: 0 in 0.291s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:12 devstack sudo[98980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.info Sep 18 00:43:12 devstack sudo[98980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:12 devstack sudo[98972]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c" returned: 0 in 0.498s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:12 devstack sudo[98982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c Sep 18 00:43:12 devstack sudo[98982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:12 devstack sudo[98980]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.info" returned: 0 in 0.322s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:12 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.info is being set with open permissions: ugo+rw Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:12 devstack sudo[98985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.info Sep 18 00:43:12 devstack sudo[98985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:12 devstack sudo[98982]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c" returned: 0 in 0.329s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-quobyte-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c" released by "delete_volume" :: held 0.888s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Created reservations ['a8479124-a356-434f-ae2a-e76d141ac4c5', '2497ecf9-c419-4538-8be1-8b7f5e5a2046', '89df4c2c-56b7-4080-808d-b3c431f37701', '2606d306-30f2-4278-a126-b9fd9f0deb34'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:12 devstack sudo[98985]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.info" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:12 devstack sudo[98989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:43:12 devstack sudo[98989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.913s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d8435558-ab30-4102-8c5c-2fe4a2790247 tempest-SnapshotDependencyTests-125521678 None] Create snapshot completed successfully Sep 18 00:43:13 devstack sudo[98989]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.279s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:13 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:43:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Deleted volume successfully. Sep 18 00:43:13 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d200c293-8ffa-4fb1-803b-9bcd69119ee3 tempest-VolumesTransfersV355Test-1098366135 None] Lock "cinder-73b9b5fb-0d57-4e93-b247-0b9c96a7b55c-delete_volume" released by "delete_volume" :: held 1.479s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Flow 'volume_create_manager' (4f137bf1-58de-45fe-b50a-64c076adb44a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e70b01-c8e5-4a88-97cd-e9f0cb0630f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e70b01-c8e5-4a88-97cd-e9f0cb0630f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:14Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76b582b9-d250-4a62-9c22-0891101ff85f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bda05729afe7470e9c228e1668401a49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=a17894d1-203a-42bc-b6fe-b86bd1195572,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:15Z,use_quota=True,user_id='049c5044abec41d9b94b28d575114f78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35aaff1-1329-4e25-885f-47dd375e38b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f35aaff1-1329-4e25-885f-47dd375e38b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e74a4e-71f5-4ea8-a882-44efc00ba9ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e74a4e-71f5-4ea8-a882-44efc00ba9ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '76b582b9-d250-4a62-9c22-0891101ff85f', 'volume_name': 'volume-76b582b9-d250-4a62-9c22-0891101ff85f', 'volume_size': 1, 'snapshot_id': 'a17894d1-203a-42bc-b6fe-b86bd1195572'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982860f4-b0cd-4161-886e-e698a4f4ee94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (982860f4-b0cd-4161-886e-e698a4f4ee94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96377613-6582-4c3e-953f-1118e545c43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Volume 76b582b9-d250-4a62-9c22-0891101ff85f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-76b582b9-d250-4a62-9c22-0891101ff85f', 'volume_size': 1, 'snapshot_id': 'a17894d1-203a-42bc-b6fe-b86bd1195572'} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-quobyte-a17894d1-203a-42bc-b6fe-b86bd1195572-76b582b9-d250-4a62-9c22-0891101ff85f" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-a17894d1-203a-42bc-b6fe-b86bd1195572-76b582b9-d250-4a62-9c22-0891101ff85f" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Creating volume 76b582b9-d250-4a62-9c22-0891101ff85f from snapshot a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:43:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-quobyte-76b582b9-d250-4a62-9c22-0891101ff85f" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-76b582b9-d250-4a62-9c22-0891101ff85f" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] snapshot: a17894d1-203a-42bc-b6fe-b86bd1195572, volume: 76b582b9-d250-4a62-9c22-0891101ff85f, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2ca110-9e0b-4e9c-9d51-af187940547d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:15 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 Sep 18 00:43:15 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:15 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572" returned: 0 in 0.570s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4408ffee-96a7-4500-bbb1-0748c50f327a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4882e088-f358-4de3-bed9-508e835f2b06]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:15 devstack sudo[99073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a Sep 18 00:43:15 devstack sudo[99073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:16 devstack sudo[99073]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a" returned: 0 in 0.519s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:43:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:43:16 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:43:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:16 devstack sudo[99078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f Sep 18 00:43:16 devstack sudo[99078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:24 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=20,cinder:UPDATE=27,cinder:INSERT=6,cinder:DELETE=4 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:43:25 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=24,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=6 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:43:28 devstack sudo[99078]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f" returned: 0 in 12.001s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a, size 1024.00 MB, duration 12.00 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:43:28 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Converted 1024.00 MB image at 85.31 MB/s Sep 18 00:43:28 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f is being set with open permissions: ugo+rw Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:28 devstack sudo[99126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f Sep 18 00:43:28 devstack sudo[99126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:28 devstack sudo[99126]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f" returned: 0 in 0.353s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-76b582b9-d250-4a62-9c22-0891101ff85f" released by "_copy_volume_from_snapshot" :: held 13.671s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-a17894d1-203a-42bc-b6fe-b86bd1195572-76b582b9-d250-4a62-9c22-0891101ff85f" released by "_create_volume_from_snapshot" :: held 13.806s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 13.829s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96377613-6582-4c3e-953f-1118e545c43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76b582b9-d250-4a62-9c22-0891101ff85f', 'volume_size': 1, 'snapshot_id': 'a17894d1-203a-42bc-b6fe-b86bd1195572'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff838ce8-efbd-4e0a-93e9-784d9df26125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:28 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Volume volume-76b582b9-d250-4a62-9c22-0891101ff85f (76b582b9-d250-4a62-9c22-0891101ff85f): created successfully Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ff838ce8-efbd-4e0a-93e9-784d9df26125) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Flow 'volume_create_manager' (4f137bf1-58de-45fe-b50a-64c076adb44a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-844d3104-5494-4a8c-82f4-68daa4771272 tempest-SnapshotDependencyTests-125521678 None] Created volume successfully. Sep 18 00:43:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-b6490849-726e-4b0a-956a-9ee487c33870 req-b81ac6cc-58f7-4705-89be-4fac49960cd6 tempest-TestShelveInstance-1941620317 None] Terminate volume connection completed successfully. Sep 18 00:43:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-b6490849-726e-4b0a-956a-9ee487c33870 req-b81ac6cc-58f7-4705-89be-4fac49960cd6 tempest-TestShelveInstance-1941620317 None] Deleting attachment fb2f4ae0-c383-4d7e-b8a1-a1b034daf7a4. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:43:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-a17894d1-203a-42bc-b6fe-b86bd1195572-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-a17894d1-203a-42bc-b6fe-b86bd1195572-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-quobyte-4408ffee-96a7-4500-bbb1-0748c50f327a" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-4408ffee-96a7-4500-bbb1-0748c50f327a" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-quobyte-a17894d1-203a-42bc-b6fe-b86bd1195572" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-a17894d1-203a-42bc-b6fe-b86bd1195572" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Deleting offline snapshot a17894d1-203a-42bc-b6fe-b86bd1195572 of volume 4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] snapshot_file for this snap is: volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[34b54f85-e074-4e49-a756-ed59c00052bf]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:30 devstack sudo[99155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 Sep 18 00:43:30 devstack sudo[99155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:30 devstack sudo[99155]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572" returned: 0 in 0.404s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4408ffee-96a7-4500-bbb1-0748c50f327a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[81250e8f-ab2b-4d0e-a0ab-d640288c3e03]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:30 devstack sudo[99160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a Sep 18 00:43:30 devstack sudo[99160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:31 devstack sudo[99160]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a" returned: 0 in 0.619s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:31 devstack sudo[99167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 Sep 18 00:43:31 devstack sudo[99167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:31 devstack sudo[99167]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572" returned: 0 in 0.469s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:31 devstack sudo[99174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572 Sep 18 00:43:31 devstack sudo[99174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:31 devstack sudo[99174]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a.a17894d1-203a-42bc-b6fe-b86bd1195572" returned: 0 in 0.278s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-a17894d1-203a-42bc-b6fe-b86bd1195572" released by "_delete_snapshot" :: held 1.898s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-4408ffee-96a7-4500-bbb1-0748c50f327a" released by "delete_snapshot" :: held 1.923s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Created reservations ['cbc3ff82-69d0-4f7a-b1e1-e463db42afab', 'ab100041-f024-42be-ac82-1f3638a2edb4', '6576f2b4-ad87-45c1-82b1-2552f8ea9bb4', '9ac0dc14-86d5-491a-8e5d-c0d2250d44a3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:43:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Delete snapshot completed successfully. Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ec68972-38a5-49d5-87c9-b175d6cde226 tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-a17894d1-203a-42bc-b6fe-b86bd1195572-delete_snapshot" released by "delete_snapshot" :: held 2.111s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-4408ffee-96a7-4500-bbb1-0748c50f327a-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-4408ffee-96a7-4500-bbb1-0748c50f327a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-d87d0701-1c22-4627-b8bc-bcee9c52b604 req-6b230427-6575-4a73-96d2-5e59a4c9bf1c tempest-TestShelveInstance-1941620317 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-d87d0701-1c22-4627-b8bc-bcee9c52b604 req-6b230427-6575-4a73-96d2-5e59a4c9bf1c tempest-TestShelveInstance-1941620317 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-d87d0701-1c22-4627-b8bc-bcee9c52b604 req-6b230427-6575-4a73-96d2-5e59a4c9bf1c tempest-TestShelveInstance-1941620317 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-d87d0701-1c22-4627-b8bc-bcee9c52b604 req-6b230427-6575-4a73-96d2-5e59a4c9bf1c tempest-TestShelveInstance-1941620317 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-c40defa1-b710-4255-9a12-8d4022c044b4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3db5519-8153-47c8-ab77-ba4751ac2387', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-quobyte-4408ffee-96a7-4500-bbb1-0748c50f327a" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-4408ffee-96a7-4500-bbb1-0748c50f327a" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d4f1d9e-5ae7-4618-a367-0e2a97f99b69]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-d87d0701-1c22-4627-b8bc-bcee9c52b604 req-6b230427-6575-4a73-96d2-5e59a4c9bf1c tempest-TestShelveInstance-1941620317 None] attachment_update completed successfully. Sep 18 00:43:32 devstack sudo[99185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a Sep 18 00:43:32 devstack sudo[99185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:32 devstack sudo[99185]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a" returned: 0 in 0.555s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:32 devstack sudo[99190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a Sep 18 00:43:32 devstack sudo[99190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:33 devstack sudo[99190]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4408ffee-96a7-4500-bbb1-0748c50f327a" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-4408ffee-96a7-4500-bbb1-0748c50f327a" released by "delete_volume" :: held 0.944s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Created reservations ['a7c3e55a-678a-43cf-a62c-bda442a706a2', '3ed336dc-a065-41a0-b760-e928bed8d6ff', '8193e9f9-097d-4217-89b0-2099817e652c', 'a87d0e53-04bd-4d89-9150-610ce6c846e4'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:33 devstack sudo[99193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:43:33 devstack sudo[99193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:33 devstack sudo[99193]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.288s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:43:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Deleted volume successfully. Sep 18 00:43:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b2d0ac44-eb61-4bac-9b96-bad78414cd3e tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-4408ffee-96a7-4500-bbb1-0748c50f327a-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-76b582b9-d250-4a62-9c22-0891101ff85f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-76b582b9-d250-4a62-9c22-0891101ff85f-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "cinder-quobyte-76b582b9-d250-4a62-9c22-0891101ff85f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-76b582b9-d250-4a62-9c22-0891101ff85f" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:34 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe9d779-1b13-4375-9aba-303ac57efda1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:43:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:34 devstack sudo[99197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f Sep 18 00:43:34 devstack sudo[99197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:35 devstack sudo[99197]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:35 devstack sudo[99202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f Sep 18 00:43:35 devstack sudo[99202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:35 devstack sudo[99202]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-76b582b9-d250-4a62-9c22-0891101ff85f" returned: 0 in 0.304s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-quobyte-76b582b9-d250-4a62-9c22-0891101ff85f" released by "delete_volume" :: held 0.800s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Created reservations ['401d53b0-3eba-45dd-b9bb-a00ef248026e', '6b235c04-b444-457e-9d67-c207a2ea3442', '417ea602-eb83-4f19-a058-f8c5a4c88ada', '343f65e0-79cf-4bb0-b740-5441bb4f0cca'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:35 devstack sudo[99302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:43:35 devstack sudo[99302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:36 devstack sudo[99302]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.460s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:36 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:43:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Deleted volume successfully. Sep 18 00:43:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63d3a680-1e2c-4f4a-bc4e-429e7bc2dedc tempest-SnapshotDependencyTests-125521678 None] Lock "cinder-76b582b9-d250-4a62-9c22-0891101ff85f-delete_volume" released by "delete_volume" :: held 1.738s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Flow 'volume_create_manager' (49aa2b52-4268-440c-991a-356b3dea5bab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dd2937-3ffc-409d-af93-4fd0bff1dddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (20dd2937-3ffc-409d-af93-4fd0bff1dddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1685037463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a07835-512f-41bc-a728-6e3752823ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66848de2649c4a7fb35369957733b940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:42Z,use_quota=True,user_id='f4b756cb8a194bd7982ea5ef6025c36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89d79c0-2647-4fb0-b5d8-3b17bf8ae037) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b89d79c0-2647-4fb0-b5d8-3b17bf8ae037) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78ea38c-043f-43bd-a398-2fc9a244853d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d78ea38c-043f-43bd-a398-2fc9a244853d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51a07835-512f-41bc-a728-6e3752823ad1', 'volume_name': 'volume-51a07835-512f-41bc-a728-6e3752823ad1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d32dc2-380a-4af3-8777-44b4a8baa139) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (86d32dc2-380a-4af3-8777-44b4a8baa139) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235c9ab2-d690-4478-9964-664bcf5549dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:41 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Volume 51a07835-512f-41bc-a728-6e3752823ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51a07835-512f-41bc-a728-6e3752823ad1', 'volume_size': 1} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1685037463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51a07835-512f-41bc-a728-6e3752823ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66848de2649c4a7fb35369957733b940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:42Z,use_quota=True,user_id='f4b756cb8a194bd7982ea5ef6025c36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Creating volume 51a07835-512f-41bc-a728-6e3752823ad1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:43:41 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:43:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:41 devstack sudo[99691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 1073741824 Sep 18 00:43:41 devstack sudo[99691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:42 devstack sudo[99691]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 1073741824" returned: 0 in 0.929s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:42 devstack sudo[99697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 Sep 18 00:43:42 devstack sudo[99697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:43 devstack sudo[99697]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:43:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.384s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (235c9ab2-d690-4478-9964-664bcf5549dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51a07835-512f-41bc-a728-6e3752823ad1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd55d796-85bd-44fa-870b-1926edad8718) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:43 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Volume volume-51a07835-512f-41bc-a728-6e3752823ad1 (51a07835-512f-41bc-a728-6e3752823ad1): created successfully Sep 18 00:43:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd55d796-85bd-44fa-870b-1926edad8718) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Flow 'volume_create_manager' (49aa2b52-4268-440c-991a-356b3dea5bab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3876fa7d-f481-44f6-bbf2-e62f567d697e tempest-AttachVolumeNegativeTest-1887761230 None] Created volume successfully. Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Flow 'volume_create_manager' (fd790a8b-ee64-44d7-ad25-6ad6e3994813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a2cdfa-4cb7-451b-8549-10f107637775) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80a2cdfa-4cb7-451b-8549-10f107637775) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1863085112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3925ba18-4e30-45f3-8e56-ba4284ff5735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2150c481849431e9a00ab0aa6c11da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:45Z,use_quota=True,user_id='4adfdbccfc4244f48e832adcb2366d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a73dbe7-c736-4ba2-8c23-b137c234454e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a73dbe7-c736-4ba2-8c23-b137c234454e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfd58db-7dc3-4a62-9af6-ca05a08c9035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfd58db-7dc3-4a62-9af6-ca05a08c9035) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3925ba18-4e30-45f3-8e56-ba4284ff5735', 'volume_name': 'volume-3925ba18-4e30-45f3-8e56-ba4284ff5735', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4ecf68-1397-4221-8a7d-33ea79a8757b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f4ecf68-1397-4221-8a7d-33ea79a8757b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2ed805-2004-424f-96a6-01e388b243d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:45 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Volume 3925ba18-4e30-45f3-8e56-ba4284ff5735: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3925ba18-4e30-45f3-8e56-ba4284ff5735', 'volume_size': 1} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:43:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1863085112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3925ba18-4e30-45f3-8e56-ba4284ff5735,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f2150c481849431e9a00ab0aa6c11da4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:43:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:43:45Z,use_quota=True,user_id='4adfdbccfc4244f48e832adcb2366d15',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Creating volume 3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:43:45 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-22635a27-bb52-4de1-9f06-de94154db4f0 req-25480ba2-8f55-4207-bf6a-0f99059198cc tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:43:45 devstack sudo[99713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 1073741824 Sep 18 00:43:45 devstack sudo[99713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:45 devstack sudo[99713]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 1073741824" returned: 0 in 0.471s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:43:46 devstack sudo[99720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:43:46 devstack sudo[99720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:43:46 devstack sudo[99720]: pam_unix(sudo:session): session closed for user root Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] <== create_volume: return (823ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.826s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-22635a27-bb52-4de1-9f06-de94154db4f0 req-25480ba2-8f55-4207-bf6a-0f99059198cc tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.801s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da2ed805-2004-424f-96a6-01e388b243d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3925ba18-4e30-45f3-8e56-ba4284ff5735', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3a2efb-c0dd-4948-b565-970bb4efb021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:43:46 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Volume volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 (3925ba18-4e30-45f3-8e56-ba4284ff5735): created successfully Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3a2efb-c0dd-4948-b565-970bb4efb021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Flow 'volume_create_manager' (fd790a8b-ee64-44d7-ad25-6ad6e3994813) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:43:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fc631d8f-c6a7-439a-ba29-da83de07dde5 tempest-VolumesActionsTest-461764033 None] Created volume successfully. Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-22635a27-bb52-4de1-9f06-de94154db4f0 req-25480ba2-8f55-4207-bf6a-0f99059198cc tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.117s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:43:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-22635a27-bb52-4de1-9f06-de94154db4f0 req-25480ba2-8f55-4207-bf6a-0f99059198cc tempest-AttachVolumeNegativeTest-1887761230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-51a07835-512f-41bc-a728-6e3752823ad1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd432e5ee-545a-44a5-94f0-e8e0b01a946b', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:43:46 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-22635a27-bb52-4de1-9f06-de94154db4f0 req-25480ba2-8f55-4207-bf6a-0f99059198cc tempest-AttachVolumeNegativeTest-1887761230 None] attachment_update completed successfully. Sep 18 00:43:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-90831678-27a6-4a14-946f-0c95cb70c249 req-a7443a5f-f5ec-44dc-b7f0-b6e1acf166d9 tempest-AttachVolumeNegativeTest-1887761230 None] Terminate volume connection completed successfully. Sep 18 00:43:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-90831678-27a6-4a14-946f-0c95cb70c249 req-a7443a5f-f5ec-44dc-b7f0-b6e1acf166d9 tempest-AttachVolumeNegativeTest-1887761230 None] Deleting attachment d432e5ee-545a-44a5-94f0-e8e0b01a946b. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:43:56 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=30,cinder:UPDATE=31,cinder:DELETE=4,cinder:INSERT=7 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:43:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e0956e13-7e2a-4b0d-b385-1bed927896b1 tempest-VolumesActionsTest-461764033 None] Acquiring lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735" by "attach_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e0956e13-7e2a-4b0d-b385-1bed927896b1 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735" acquired by "attach_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e0956e13-7e2a-4b0d-b385-1bed927896b1 tempest-VolumesActionsTest-461764033 None] Attaching volume 3925ba18-4e30-45f3-8e56-ba4284ff5735 to instance b7f8547d-1090-4b49-aebf-b9be2554d019 at mountpoint /dev/vdb on host None. Sep 18 00:43:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e0956e13-7e2a-4b0d-b385-1bed927896b1 tempest-VolumesActionsTest-461764033 None] Attach volume completed successfully. Sep 18 00:43:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e0956e13-7e2a-4b0d-b385-1bed927896b1 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735" released by "attach_volume" :: held 0.093s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:43:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba3ce57a-7b65-48c6-af11-adb6507ac639 tempest-VolumesActionsTest-461764033 None] Acquiring lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-detach_volume" by "detach_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:43:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba3ce57a-7b65-48c6-af11-adb6507ac639 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-detach_volume" acquired by "detach_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:43:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ba3ce57a-7b65-48c6-af11-adb6507ac639 tempest-VolumesActionsTest-461764033 None] Detaching volume 3925ba18-4e30-45f3-8e56-ba4284ff5735 from instance b7f8547d-1090-4b49-aebf-b9be2554d019. Sep 18 00:43:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ba3ce57a-7b65-48c6-af11-adb6507ac639 tempest-VolumesActionsTest-461764033 None] Detach volume completed successfully. Sep 18 00:43:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba3ce57a-7b65-48c6-af11-adb6507ac639 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-detach_volume" released by "detach_volume" :: held 0.070s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:44:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:44:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:44:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:44:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:44:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:44:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:44:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:04 devstack sudo[100004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:44:04 devstack sudo[100004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:04 devstack sudo[100004]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.629s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:05 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:44:05 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:44:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:44:05 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:44:08 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:INSERT=10,cinder:SELECT=47,cinder:UPDATE=38,cinder:DELETE=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:44:08 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=9,cinder:UPDATE=4 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:44:09 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-edf3439e-5538-4a29-a633-fbe7a8ff1441 tempest-TestShelveInstance-1941620317 None] Terminate volume connection completed successfully. Sep 18 00:44:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-edf3439e-5538-4a29-a633-fbe7a8ff1441 tempest-TestShelveInstance-1941620317 None] Deleting attachment b3db5519-8153-47c8-ab77-ba4751ac2387. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:44:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Acquiring lock "cinder-c40defa1-b710-4255-9a12-8d4022c044b4-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:44:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Lock "cinder-c40defa1-b710-4255-9a12-8d4022c044b4-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:44:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Acquiring lock "cinder-quobyte-c40defa1-b710-4255-9a12-8d4022c044b4" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:44:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Lock "cinder-quobyte-c40defa1-b710-4255-9a12-8d4022c044b4" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:44:09 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[483c1575-a70a-48ef-8733-ad8a6fee80ea]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:44:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:09 devstack sudo[100077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 Sep 18 00:44:09 devstack sudo[100077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:10 devstack sudo[100077]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4" returned: 0 in 0.594s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:10 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4 Sep 18 00:44:10 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:10 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c40defa1-b710-4255-9a12-8d4022c044b4" returned: 0 in 0.541s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:10 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Lock "cinder-quobyte-c40defa1-b710-4255-9a12-8d4022c044b4" released by "delete_volume" :: held 1.259s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:44:10 devstack cinder-volume[86526]: DEBUG cinder.quota [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Created reservations ['a64500be-7517-4ab1-a024-9b9f1838963d', 'ff9c50e3-4ceb-42ed-8b9f-0a21d28d09ce', '4d6ed126-29ee-46ce-b1f4-636da7d1de2f', '475e99a8-9762-41b5-961a-83a31fb2a225'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:11 devstack sudo[100135]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:44:11 devstack sudo[100135]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:11 devstack sudo[100135]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.785s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG cinder.manager [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:44:11 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Deleted volume successfully. Sep 18 00:44:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-cc546414-3f4d-48e9-bdac-3412d5ad739c req-2bcde9c7-941f-4890-9662-40c1a880192f tempest-TestShelveInstance-1941620317 None] Lock "cinder-c40defa1-b710-4255-9a12-8d4022c044b4-delete_volume" released by "delete_volume" :: held 2.533s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:44:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b347fecf-46e0-48e2-a77c-a391719d16cd tempest-VolumesActionsTest-461764033 None] Acquiring lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735" by "attach_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:44:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b347fecf-46e0-48e2-a77c-a391719d16cd tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735" acquired by "attach_volume" :: waited 0.041s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:44:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b347fecf-46e0-48e2-a77c-a391719d16cd tempest-VolumesActionsTest-461764033 None] Attaching volume 3925ba18-4e30-45f3-8e56-ba4284ff5735 to instance f1e4ab5d-5368-4600-a121-28f92af0f8d7 at mountpoint /dev/vdb on host None. Sep 18 00:44:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b347fecf-46e0-48e2-a77c-a391719d16cd tempest-VolumesActionsTest-461764033 None] Attach volume completed successfully. Sep 18 00:44:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b347fecf-46e0-48e2-a77c-a391719d16cd tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735" released by "attach_volume" :: held 0.160s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:44:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b3c7d75a-d946-4b4a-b853-eb8b7fb8d4b9 tempest-VolumesActionsTest-461764033 None] Acquiring lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-detach_volume" by "detach_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:44:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b3c7d75a-d946-4b4a-b853-eb8b7fb8d4b9 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-detach_volume" acquired by "detach_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:44:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b3c7d75a-d946-4b4a-b853-eb8b7fb8d4b9 tempest-VolumesActionsTest-461764033 None] Detaching volume 3925ba18-4e30-45f3-8e56-ba4284ff5735 from instance f1e4ab5d-5368-4600-a121-28f92af0f8d7. Sep 18 00:44:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b3c7d75a-d946-4b4a-b853-eb8b7fb8d4b9 tempest-VolumesActionsTest-461764033 None] Detach volume completed successfully. Sep 18 00:44:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b3c7d75a-d946-4b4a-b853-eb8b7fb8d4b9 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:44:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:44:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:44:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6efe700e-0d3d-4aca-9de5-196bd686669d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:44:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:20 devstack sudo[100220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:44:20 devstack sudo[100220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:20 devstack sudo[100220]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.374s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a085fe6-26ab-4e1a-9145-f54ae217a460]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:44:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:20 devstack sudo[100226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:44:20 devstack sudo[100226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:21 devstack sudo[100226]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.409s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.403841a8-34d6-4daf-a23b-ee570f5462581xolg02c.img {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:21 devstack sudo[100231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.403841a8-34d6-4daf-a23b-ee570f5462581xolg02c.img Sep 18 00:44:21 devstack sudo[100231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:25 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=11,cinder:INSERT=5,cinder:UPDATE=11 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:44:28 devstack sudo[100231]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.403841a8-34d6-4daf-a23b-ee570f5462581xolg02c.img" returned: 0 in 7.372s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[36261cdb-a0c1-47b1-9e57-0923f1cc392e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:44:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:28 devstack sudo[100245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:44:28 devstack sudo[100245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:29 devstack sudo[100245]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.543s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:29 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735, size 1024.00 MB, duration 7.37 sec, destination /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.403841a8-34d6-4daf-a23b-ee570f5462581xolg02c.img {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:44:29 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Converted 1024.00 MB image at 138.89 MB/s Sep 18 00:44:29 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] 403841a8-34d6-4daf-a23b-ee570f546258 was raw, no need to convert to raw {{(pid=86526) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Flow 'volume_create_manager' (2688d9ca-bf33-4f95-88cc-6335deb74fd1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fdcb29-2f43-40e1-abbf-f7ce6797a551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3fdcb29-2f43-40e1-abbf-f7ce6797a551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1375111681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e6fb8e-c991-4e59-8754-bc78c8b49c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66848de2649c4a7fb35369957733b940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:44:33Z,use_quota=True,user_id='f4b756cb8a194bd7982ea5ef6025c36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0527979d-29e6-47ca-8c4d-25eeeb95b470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0527979d-29e6-47ca-8c4d-25eeeb95b470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0caeee4-a054-4dda-b77f-39580a3ebbda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0caeee4-a054-4dda-b77f-39580a3ebbda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '10e6fb8e-c991-4e59-8754-bc78c8b49c2e', 'volume_name': 'volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb284c2-7d03-4ae7-b732-6c6b6e411375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb284c2-7d03-4ae7-b732-6c6b6e411375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ef1986-230a-4851-b155-593185540241) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Volume 10e6fb8e-c991-4e59-8754-bc78c8b49c2e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e', 'volume_size': 1} Sep 18 00:44:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:44:42 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:44:42 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=18,cinder:UPDATE=11,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 30.997s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Uploaded volume to glance image-id: 403841a8-34d6-4daf-a23b-ee570f546258. {{(pid=86526) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 18.637s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:44:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1375111681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=10e6fb8e-c991-4e59-8754-bc78c8b49c2e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='66848de2649c4a7fb35369957733b940',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:44:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:44:33Z,use_quota=True,user_id='f4b756cb8a194bd7982ea5ef6025c36d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Creating volume 10e6fb8e-c991-4e59-8754-bc78c8b49c2e {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:44:51 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-adddb328-afd9-492b-82e6-4ac00a849aa2 tempest-VolumesActionsTest-461764033 None] Copy volume to image completed successfully. Sep 18 00:44:51 devstack sudo[100273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e 1073741824 Sep 18 00:44:51 devstack sudo[100273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:51 devstack sudo[100273]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e 1073741824" returned: 0 in 0.539s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:52 devstack sudo[100279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e Sep 18 00:44:52 devstack sudo[100279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:52 devstack sudo[100279]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e" returned: 0 in 0.303s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72ef1986-230a-4851-b155-593185540241) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61ee176-1ae8-4742-9cbc-a854ca77ab82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:52 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Volume volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e (10e6fb8e-c991-4e59-8754-bc78c8b49c2e): created successfully Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a61ee176-1ae8-4742-9cbc-a854ca77ab82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Flow 'volume_create_manager' (2688d9ca-bf33-4f95-88cc-6335deb74fd1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:44:52 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ca0e31e5-b9cb-433d-bc13-ccb914a02609 tempest-AttachVolumeNegativeTest-1887761230 None] Created volume successfully. Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ad31b92-3fcd-448f-a81c-6c4f50d9f1b2]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:53 devstack sudo[100282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:44:53 devstack sudo[100282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:53 devstack sudo[100282]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.440s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[96547cf5-45b8-4369-ace3-0d8bf667c0ee]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:53 devstack sudo[100291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:44:53 devstack sudo[100291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:53 devstack sudo[100291]: pam_unix(sudo:session): session closed for user root Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.433s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:44:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:44:54 devstack sudo[100304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img Sep 18 00:44:54 devstack sudo[100304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-3991567e-13b2-4002-920e-e65ef332c5d7 req-86dcb275-f65f-416d-9751-9da9a741a868 tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Flow 'volume_create_manager' (a73aab1a-b8de-48e2-8f6c-cf77a48e6033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad140850-334f-465f-9d09-1c768542c9ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ad140850-334f-465f-9d09-1c768542c9ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-221563153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41b811d-8ce5-405b-b47a-a973513172f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3ad2ce5824197b36be4470d17cb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:44:54Z,use_quota=True,user_id='bd77f420d980475eb3c94cb7d6380600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46242c70-9905-411f-8757-5fac01784254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (46242c70-9905-411f-8757-5fac01784254) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2561e3-ef81-4c3e-a469-6beb420ad1bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a2561e3-ef81-4c3e-a469-6beb420ad1bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e41b811d-8ce5-405b-b47a-a973513172f9', 'volume_name': 'volume-e41b811d-8ce5-405b-b47a-a973513172f9', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309ebb9d-ec21-41f5-8eb0-e16e08eeed49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (309ebb9d-ec21-41f5-8eb0-e16e08eeed49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5feedfe-bddf-484b-9686-a3af25b9a30e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:44:54 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Volume e41b811d-8ce5-405b-b47a-a973513172f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e41b811d-8ce5-405b-b47a-a973513172f9', 'volume_size': 1} Sep 18 00:44:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:02 devstack sudo[100304]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img" returned: 0 in 8.153s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7199761e-9c77-4213-8de0-47a92e476f30]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:02 devstack sudo[100395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:45:02 devstack sudo[100395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:02 devstack sudo[100395]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.786s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:45:02 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Converted 1024.00 MB image at 125.52 MB/s Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] 9dc0dcf5-6334-414f-a1c5-05585b7cbb5c was raw, converting to qcow2 {{(pid=86526) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c7a293-f4cc-4833-a7f7-11373e3dede6]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:03 devstack sudo[100415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img Sep 18 00:45:03 devstack sudo[100415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:03 devstack sudo[100415]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:03 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img Sep 18 00:45:03 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:03 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img" returned: 1 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:45:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img /opt/stack/data/cinder/conversion/vol_upload_wwisq2rp {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:03 devstack sudo[100460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img /opt/stack/data/cinder/conversion/vol_upload_wwisq2rp Sep 18 00:45:03 devstack sudo[100460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=4,cinder:INSERT=1,cinder:DELETE=1,cinder:SELECT=2 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:04 devstack sudo[100468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:04 devstack sudo[100468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:04 devstack sudo[100460]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img /opt/stack/data/cinder/conversion/vol_upload_wwisq2rp" returned: 0 in 0.756s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Image conversion details: src /opt/stack/data/cinder/conversion/3925ba18-4e30-45f3-8e56-ba4284ff5735.temp_image.9dc0dcf5-6334-414f-a1c5-05585b7cbb5cigd1dwzd.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_wwisq2rp {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:45:04 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9ce717-91aa-4646-ac92-62d77169ee27]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wwisq2rp {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:04 devstack sudo[100470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wwisq2rp Sep 18 00:45:04 devstack sudo[100470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:04 devstack sudo[100468]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.375s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:45:04 devstack sudo[100470]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_wwisq2rp" returned: 0 in 0.402s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.507s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Uploaded volume to glance image-id: 9dc0dcf5-6334-414f-a1c5-05585b7cbb5c. {{(pid=86526) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-3991567e-13b2-4002-920e-e65ef332c5d7 req-86dcb275-f65f-416d-9751-9da9a741a868 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 12.460s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-3991567e-13b2-4002-920e-e65ef332c5d7 req-86dcb275-f65f-416d-9751-9da9a741a868 tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.290s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:44:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-221563153',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e41b811d-8ce5-405b-b47a-a973513172f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3ad2ce5824197b36be4470d17cb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:44:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:44:54Z,use_quota=True,user_id='bd77f420d980475eb3c94cb7d6380600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Creating volume e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:45:06 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:06 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7ff33dbb-c18e-4b5b-8c6a-ddbfacb1de30 tempest-VolumesActionsTest-461764033 None] Copy volume to image completed successfully. Sep 18 00:45:06 devstack sudo[100478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 1073741824 Sep 18 00:45:06 devstack sudo[100478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:06 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-3991567e-13b2-4002-920e-e65ef332c5d7 req-86dcb275-f65f-416d-9751-9da9a741a868 tempest-AttachVolumeNegativeTest-1887761230 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ef1fe52-ccdc-4913-b052-5c7ed6c31200', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:45:06 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-3991567e-13b2-4002-920e-e65ef332c5d7 req-86dcb275-f65f-416d-9751-9da9a741a868 tempest-AttachVolumeNegativeTest-1887761230 None] attachment_update completed successfully. Sep 18 00:45:07 devstack sudo[100478]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 1073741824" returned: 0 in 0.732s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:07 devstack sudo[100896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 Sep 18 00:45:07 devstack sudo[100896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:07 devstack sudo[100896]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9" returned: 0 in 0.348s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e5feedfe-bddf-484b-9686-a3af25b9a30e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e41b811d-8ce5-405b-b47a-a973513172f9', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c66ba1a-fdea-4a54-98d4-8e05de766f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Volume volume-e41b811d-8ce5-405b-b47a-a973513172f9 (e41b811d-8ce5-405b-b47a-a973513172f9): created successfully Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c66ba1a-fdea-4a54-98d4-8e05de766f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Flow 'volume_create_manager' (a73aab1a-b8de-48e2-8f6c-cf77a48e6033) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:07 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d2c525cc-6f6a-4ac5-a365-6d8efebc2b2f tempest-TestStampPattern-596157518 None] Created volume successfully. Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Acquiring lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Acquiring lock "cinder-quobyte-3925ba18-4e30-45f3-8e56-ba4284ff5735" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Lock "cinder-quobyte-3925ba18-4e30-45f3-8e56-ba4284ff5735" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c312704-f4bd-4197-8aac-98bc57035aca]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:08 devstack sudo[100900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:45:08 devstack sudo[100900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:08 devstack sudo[100900]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.358s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:08 devstack sudo[100905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735 Sep 18 00:45:08 devstack sudo[100905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:08 devstack sudo[100905]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3925ba18-4e30-45f3-8e56-ba4284ff5735" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Lock "cinder-quobyte-3925ba18-4e30-45f3-8e56-ba4284ff5735" released by "delete_volume" :: held 0.678s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Created reservations ['8f9746b7-8060-4f1e-bae5-403d8bc91ccd', '06756460-5943-439f-b836-c557c576b95b', '2d50753e-b557-4862-ae0f-0340fe4c0cab', 'cce0d0dd-7f02-4599-a945-e719bad04d6f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:08 devstack sudo[100908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:08 devstack sudo[100908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:09 devstack sudo[100908]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:09 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:09 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Deleted volume successfully. Sep 18 00:45:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-705048b2-0d69-4265-ba6e-41c98ebb56f7 tempest-VolumesActionsTest-461764033 None] Lock "cinder-3925ba18-4e30-45f3-8e56-ba4284ff5735-delete_volume" released by "delete_volume" :: held 1.312s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:09 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-c51e73f0-9c6f-4296-a718-6d639a92ed86 req-3f150a34-dd6d-47c4-bf5a-c4b9f201be02 tempest-AttachVolumeNegativeTest-1887761230 None] Terminate volume connection completed successfully. Sep 18 00:45:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-c51e73f0-9c6f-4296-a718-6d639a92ed86 req-3f150a34-dd6d-47c4-bf5a-c4b9f201be02 tempest-AttachVolumeNegativeTest-1887761230 None] Deleting attachment 6ef1fe52-ccdc-4913-b052-5c7ed6c31200. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:45:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "cinder-10e6fb8e-c991-4e59-8754-bc78c8b49c2e-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-10e6fb8e-c991-4e59-8754-bc78c8b49c2e-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "cinder-quobyte-10e6fb8e-c991-4e59-8754-bc78c8b49c2e" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-quobyte-10e6fb8e-c991-4e59-8754-bc78c8b49c2e" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:15 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5445480e-4148-469d-84dd-62354e001d03]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:15 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e Sep 18 00:45:15 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:15 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e" returned: 0 in 0.552s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:15 devstack sudo[100977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e Sep 18 00:45:15 devstack sudo[100977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:15 devstack sudo[100977]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-10e6fb8e-c991-4e59-8754-bc78c8b49c2e" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-quobyte-10e6fb8e-c991-4e59-8754-bc78c8b49c2e" released by "delete_volume" :: held 0.921s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:15 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Created reservations ['6239babb-c0cc-4838-8eeb-213b2b8d37b6', '64ae8031-3f0a-444b-95a7-4f2f577910e6', '95f9b7db-4888-41dc-bfa0-5876d0ae2b7d', '1cf7789e-31cb-43d6-8598-38da18e34364'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:16 devstack sudo[101000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:16 devstack sudo[101000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "cinder-51a07835-512f-41bc-a728-6e3752823ad1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-51a07835-512f-41bc-a728-6e3752823ad1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "cinder-quobyte-51a07835-512f-41bc-a728-6e3752823ad1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-quobyte-51a07835-512f-41bc-a728-6e3752823ad1" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[298ee841-7d05-43fb-9e25-91a9e0116a7b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:16 devstack sudo[101000]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.407s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Deleted volume successfully. Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2c6856e2-a1ad-4955-b1e8-a59d23ceccce tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-10e6fb8e-c991-4e59-8754-bc78c8b49c2e-delete_volume" released by "delete_volume" :: held 1.648s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:16 devstack sudo[101003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 Sep 18 00:45:16 devstack sudo[101003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:16 devstack sudo[101003]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1" returned: 0 in 0.404s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:16 devstack sudo[101008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1 Sep 18 00:45:16 devstack sudo[101008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:17 devstack sudo[101008]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-51a07835-512f-41bc-a728-6e3752823ad1" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-quobyte-51a07835-512f-41bc-a728-6e3752823ad1" released by "delete_volume" :: held 0.721s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Created reservations ['358befb2-e07a-4869-b284-77937a1ec9e5', '617b868a-0d53-42fe-830e-63c9de357665', 'a054ceef-a371-48a7-9ee3-1101b2639cae', '90c8d293-6b4d-4b4a-ac10-d0f43aa250c1'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:17 devstack sudo[101011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:17 devstack sudo[101011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:17 devstack sudo[101011]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Deleted volume successfully. Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bfd115da-56a7-4a8c-8d0f-32d94a5a1abd tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-51a07835-512f-41bc-a728-6e3752823ad1-delete_volume" released by "delete_volume" :: held 1.247s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "cinder-2fe9e20e-10d4-431b-aee0-95afbfb5094f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-2fe9e20e-10d4-431b-aee0-95afbfb5094f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "cinder-quobyte-2fe9e20e-10d4-431b-aee0-95afbfb5094f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-quobyte-2fe9e20e-10d4-431b-aee0-95afbfb5094f" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[24733b46-29aa-485c-899d-8e3d43a1c0d4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:17 devstack sudo[101014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f Sep 18 00:45:17 devstack sudo[101014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:18 devstack sudo[101014]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f" returned: 0 in 0.380s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:18 devstack sudo[101019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f Sep 18 00:45:18 devstack sudo[101019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:18 devstack sudo[101019]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2fe9e20e-10d4-431b-aee0-95afbfb5094f" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-quobyte-2fe9e20e-10d4-431b-aee0-95afbfb5094f" released by "delete_volume" :: held 0.677s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Created reservations ['7ba4df78-f7cd-4a5e-81d2-fc2894866d7c', '1ed082af-3716-42fe-8b07-2fb199fec008', '4d9b6bda-cd10-4aaa-b2fe-b809cc3fbf15', '98172089-4283-495c-bafc-895dc3c2978f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:18 devstack sudo[101022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:18 devstack sudo[101022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:18 devstack sudo[101022]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.269s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Deleted volume successfully. Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Flow 'volume_create_manager' (4ff0c722-ab07-4d3a-bede-366a547e7392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c19b73-c981-44c7-863b-24da0fbd45fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-333bece2-cabc-4708-92cd-ce213056bb3f tempest-AttachVolumeNegativeTest-1887761230 None] Lock "cinder-2fe9e20e-10d4-431b-aee0-95afbfb5094f-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c19b73-c981-44c7-863b-24da0fbd45fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-731820103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09264a8b-3690-406d-aefd-52d0453d9d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029bd6947c8e4804a1cf31195884093c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:19Z,use_quota=True,user_id='5e24470b96a746e9bc7d8831e5987ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b084388d-7c25-4b4b-b77e-5a3e4bb66d63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b084388d-7c25-4b4b-b77e-5a3e4bb66d63) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97c4df6-ee1a-4481-8e68-f1162b2886d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e97c4df6-ee1a-4481-8e68-f1162b2886d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '09264a8b-3690-406d-aefd-52d0453d9d10', 'volume_name': 'volume-09264a8b-3690-406d-aefd-52d0453d9d10', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b5c142-7232-4ce9-935c-12b821f0301a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83b5c142-7232-4ce9-935c-12b821f0301a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27da920-fbbf-421c-a4c8-39124ef79239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Volume 09264a8b-3690-406d-aefd-52d0453d9d10: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-09264a8b-3690-406d-aefd-52d0453d9d10', 'volume_size': 1} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-731820103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=09264a8b-3690-406d-aefd-52d0453d9d10,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029bd6947c8e4804a1cf31195884093c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:19Z,use_quota=True,user_id='5e24470b96a746e9bc7d8831e5987ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Creating volume 09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:45:18 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:45:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:19 devstack sudo[101025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 1073741824 Sep 18 00:45:19 devstack sudo[101025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:19 devstack sudo[101025]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 1073741824" returned: 0 in 0.448s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:19 devstack sudo[101031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 Sep 18 00:45:19 devstack sudo[101031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:19 devstack sudo[101031]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10" returned: 0 in 0.269s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] <== create_volume: return (764ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.767s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b27da920-fbbf-421c-a4c8-39124ef79239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-09264a8b-3690-406d-aefd-52d0453d9d10', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab7be23-aac9-41a9-99e0-3dcaa753d174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Volume volume-09264a8b-3690-406d-aefd-52d0453d9d10 (09264a8b-3690-406d-aefd-52d0453d9d10): created successfully Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fab7be23-aac9-41a9-99e0-3dcaa753d174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Flow 'volume_create_manager' (4ff0c722-ab07-4d3a-bede-366a547e7392) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c131debb-3954-41d0-9da3-c0aa9e02b491 tempest-VolumesCloneTest-1482638621 None] Created volume successfully. Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Flow 'volume_create_manager' (e8c5fc6e-64ec-40ea-b764-c4f4b1d50b21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b676c3d-51ee-4bd1-92fd-787c0331c311) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b676c3d-51ee-4bd1-92fd-787c0331c311) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-390242273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5f1fbd9-3ac7-4012-a6de-72007cfd6533,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='029bd6947c8e4804a1cf31195884093c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:21Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=09264a8b-3690-406d-aefd-52d0453d9d10,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:21Z,use_quota=True,user_id='5e24470b96a746e9bc7d8831e5987ec9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036b3e1b-d7d9-4356-a986-c3434791d7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (036b3e1b-d7d9-4356-a986-c3434791d7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344cf29c-2849-4cfc-925b-c95fa57e3e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344cf29c-2849-4cfc-925b-c95fa57e3e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'a5f1fbd9-3ac7-4012-a6de-72007cfd6533', 'volume_name': 'volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533', 'volume_size': 2, 'source_volid': '09264a8b-3690-406d-aefd-52d0453d9d10', 'source_volstatus': 'available'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17c8d71-cb89-4874-b064-a02957288b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c17c8d71-cb89-4874-b064-a02957288b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2039910a-8d7e-4c40-8558-78c39c12e3e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Volume a5f1fbd9-3ac7-4012-a6de-72007cfd6533: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533', 'volume_size': 2, 'source_volid': '09264a8b-3690-406d-aefd-52d0453d9d10', 'source_volstatus': 'available'} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:21 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Cloning volume 09264a8b-3690-406d-aefd-52d0453d9d10 to volume a5f1fbd9-3ac7-4012-a6de-72007cfd6533 Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Creating offline snapshot eca4c495-8e7a-4934-ab0e-7d0a470c44e2 of volume 09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec7d0b58-2c54-4130-9d4d-07b9bd9e2601]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:21 devstack sudo[101036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 Sep 18 00:45:21 devstack sudo[101036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:21 devstack sudo[101036]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10" returned: 0 in 0.368s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:22 devstack sudo[101041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 1G Sep 18 00:45:22 devstack sudo[101041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:22 devstack sudo[101041]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 1G" returned: 0 in 0.486s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09264a8b-3690-406d-aefd-52d0453d9d10 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:22 devstack sudo[101047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09264a8b-3690-406d-aefd-52d0453d9d10 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 Sep 18 00:45:22 devstack sudo[101047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:22 devstack sudo[101047]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-09264a8b-3690-406d-aefd-52d0453d9d10 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2" returned: 0 in 0.309s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:22 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 is being set with open permissions: ugo+rw Sep 18 00:45:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:22 devstack sudo[101052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 Sep 18 00:45:22 devstack sudo[101052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:23 devstack sudo[101052]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:23 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.info Sep 18 00:45:23 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:23 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.info" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:23 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.info is being set with open permissions: ugo+rw Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:23 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.info Sep 18 00:45:23 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:23 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.info" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Acquiring lock "cinder-quobyte-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] snapshot: eca4c495-8e7a-4934-ab0e-7d0a470c44e2, volume: a5f1fbd9-3ac7-4012-a6de-72007cfd6533, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6858f6e7-5671-4ef6-8151-a42ff6f2b721]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:23 devstack sudo[101062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 Sep 18 00:45:23 devstack sudo[101062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:24 devstack sudo[101062]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2" returned: 0 in 0.461s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09264a8b-3690-406d-aefd-52d0453d9d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[56a63040-ac65-47b6-846b-cda9b26b7d78]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:24 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 Sep 18 00:45:24 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:24 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:45:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:24 devstack sudo[101072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 Sep 18 00:45:24 devstack sudo[101072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-a85969b5-72b2-4ab7-b20c-b0a604a5d450 req-42d8b34a-c2d9-446b-a4be-7c6bf2e84b9a tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Flow 'volume_create_manager' (52ecc2fb-26cd-4f12-bf9a-288df5be600b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dd1ed0-4d2b-44a4-b31f-dbc41fb67345) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1dd1ed0-4d2b-44a4-b31f-dbc41fb67345) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1835448088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d026125-fe86-407c-9062-ad74356ab24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bce21d8896b44b2aad4cbfda88629f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:28Z,use_quota=True,user_id='2197c32f05e7411baf64db832efaccd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3ff281-46e4-42f8-9c0c-7790b1186693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c3ff281-46e4-42f8-9c0c-7790b1186693) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a2cb43-377c-4a08-8cef-999d5304da94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80a2cb43-377c-4a08-8cef-999d5304da94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d026125-fe86-407c-9062-ad74356ab24d', 'volume_name': 'volume-4d026125-fe86-407c-9062-ad74356ab24d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d257859-d629-4ab1-b821-115e18bc5ca1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d257859-d629-4ab1-b821-115e18bc5ca1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb88d45-446c-4bb2-999c-27fd449bbd17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:28 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Volume 4d026125-fe86-407c-9062-ad74356ab24d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d026125-fe86-407c-9062-ad74356ab24d', 'volume_size': 1} Sep 18 00:45:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:31 devstack sudo[101072]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" returned: 0 in 7.026s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10, size 1024.00 MB, duration 7.03 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:45:31 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Converted 1024.00 MB image at 145.73 MB/s Sep 18 00:45:31 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 is being set with open permissions: ugo+rw Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:31 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 Sep 18 00:45:31 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:31 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" returned: 0 in 0.242s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" released by "_copy_volume_from_snapshot" :: held 8.240s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Acquiring lock "cinder-quobyte-eca4c495-8e7a-4934-ab0e-7d0a470c44e2" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-eca4c495-8e7a-4934-ab0e-7d0a470c44e2" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Deleting offline snapshot eca4c495-8e7a-4934-ab0e-7d0a470c44e2 of volume 09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] snapshot_file for this snap is: volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bfa8daf-28ff-4256-b84b-e4f8b9b85ba2]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:32 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 Sep 18 00:45:32 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:32 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2" returned: 0 in 0.362s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-09264a8b-3690-406d-aefd-52d0453d9d10(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:45:32 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[120d775c-e15e-4e39-a8eb-ae88d415ea43]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:32 devstack sudo[101109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 Sep 18 00:45:32 devstack sudo[101109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:32 devstack sudo[101109]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10" returned: 0 in 0.541s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:32 devstack sudo[101114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 Sep 18 00:45:32 devstack sudo[101114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:33 devstack sudo[101114]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2" returned: 0 in 0.317s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:33 devstack sudo[101120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2 Sep 18 00:45:33 devstack sudo[101120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:33 devstack sudo[101120]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10.eca4c495-8e7a-4934-ab0e-7d0a470c44e2" returned: 0 in 0.247s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-eca4c495-8e7a-4934-ab0e-7d0a470c44e2" released by "_delete_snapshot" :: held 1.559s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 11.986s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-a85969b5-72b2-4ab7-b20c-b0a604a5d450 req-42d8b34a-c2d9-446b-a4be-7c6bf2e84b9a tempest-TestStampPattern-596157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.498s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-a85969b5-72b2-4ab7-b20c-b0a604a5d450 req-42d8b34a-c2d9-446b-a4be-7c6bf2e84b9a tempest-TestStampPattern-596157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.365s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1835448088',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d026125-fe86-407c-9062-ad74356ab24d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9bce21d8896b44b2aad4cbfda88629f8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:28Z,use_quota=True,user_id='2197c32f05e7411baf64db832efaccd1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Creating volume 4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:45:33 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2039910a-8d7e-4c40-8558-78c39c12e3e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533', 'volume_size': 2, 'source_volid': '09264a8b-3690-406d-aefd-52d0453d9d10', 'source_volstatus': 'available'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa993fa-bb73-47d2-a3e7-eb8f3e7c0d1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:33 devstack sudo[101123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d 1073741824 Sep 18 00:45:33 devstack sudo[101123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Volume volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 (a5f1fbd9-3ac7-4012-a6de-72007cfd6533): created successfully Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (efa993fa-bb73-47d2-a3e7-eb8f3e7c0d1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Flow 'volume_create_manager' (e8c5fc6e-64ec-40ea-b764-c4f4b1d50b21) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-a85969b5-72b2-4ab7-b20c-b0a604a5d450 req-42d8b34a-c2d9-446b-a4be-7c6bf2e84b9a tempest-TestStampPattern-596157518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-e41b811d-8ce5-405b-b47a-a973513172f9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '73114cac-f049-4fce-92de-3830ab4d7bfb', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:45:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-dee65bda-4a12-46e4-a665-9e9bc8f2eaa2 tempest-VolumesCloneTest-1482638621 None] Created volume successfully. Sep 18 00:45:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-a85969b5-72b2-4ab7-b20c-b0a604a5d450 req-42d8b34a-c2d9-446b-a4be-7c6bf2e84b9a tempest-TestStampPattern-596157518 None] attachment_update completed successfully. Sep 18 00:45:34 devstack sudo[101123]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d 1073741824" returned: 0 in 0.468s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:34 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d Sep 18 00:45:34 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:34 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d" returned: 0 in 0.276s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fb88d45-446c-4bb2-999c-27fd449bbd17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d026125-fe86-407c-9062-ad74356ab24d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022b67c4-fc83-4477-8366-870449db36f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Volume volume-4d026125-fe86-407c-9062-ad74356ab24d (4d026125-fe86-407c-9062-ad74356ab24d): created successfully Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (022b67c4-fc83-4477-8366-870449db36f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Flow 'volume_create_manager' (52ecc2fb-26cd-4f12-bf9a-288df5be600b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:34 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-e28432c2-d525-4944-b2a4-ccd02bbd05ac req-32ebbb94-363f-4139-afc3-74aea2ae328d tempest-VolumesSnapshotsTestJSON-1616987172 None] Created volume successfully. Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Creating offline snapshot 62014c85-e8f7-45b5-89a9-97d9c268dafa of volume 4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a57ccd6-2179-4184-a487-2515e2f15bfb]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:34 devstack sudo[101546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d Sep 18 00:45:34 devstack sudo[101546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Acquiring lock "cinder-a5f1fbd9-3ac7-4012-a6de-72007cfd6533-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Lock "cinder-a5f1fbd9-3ac7-4012-a6de-72007cfd6533-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Acquiring lock "cinder-quobyte-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[af18c92e-abdc-4aa4-8fe0-ba44f19d45d2]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:35 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 Sep 18 00:45:35 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:35 devstack sudo[101546]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d" returned: 0 in 0.414s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:35 devstack sudo[101555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa 1G Sep 18 00:45:35 devstack sudo[101555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:35 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" returned: 0 in 0.388s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:35 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533 Sep 18 00:45:35 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:35 devstack sudo[101555]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa 1G" returned: 0 in 0.462s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d026125-fe86-407c-9062-ad74356ab24d -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:35 devstack sudo[101574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d026125-fe86-407c-9062-ad74356ab24d -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa Sep 18 00:45:35 devstack sudo[101574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:35 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-a5f1fbd9-3ac7-4012-a6de-72007cfd6533" released by "delete_volume" :: held 0.726s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Created reservations ['8e4211a6-0bf8-4aea-ad02-aa00da0a987f', '56bb1ac3-193c-4a44-8ff9-a4ea882b6a46', 'b0aa4021-2f84-4907-ae2f-2f75babc0275', '34b780ad-bc23-412b-afea-fbbf3cc51a0d'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:35 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:35 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:36 devstack sudo[101574]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4d026125-fe86-407c-9062-ad74356ab24d -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa" returned: 0 in 0.343s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:36 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa is being set with open permissions: ugo+rw Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:36 devstack sudo[101582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa Sep 18 00:45:36 devstack sudo[101582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:36 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.305s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Deleted volume successfully. Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e2499fd-50e1-48f0-a5f3-0950da20995a tempest-VolumesCloneTest-1482638621 None] Lock "cinder-a5f1fbd9-3ac7-4012-a6de-72007cfd6533-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Acquiring lock "cinder-09264a8b-3690-406d-aefd-52d0453d9d10-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Lock "cinder-09264a8b-3690-406d-aefd-52d0453d9d10-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Acquiring lock "cinder-quobyte-09264a8b-3690-406d-aefd-52d0453d9d10" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-09264a8b-3690-406d-aefd-52d0453d9d10" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:36 devstack sudo[101582]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8295d1f0-2165-436f-835b-82fcd586ed25]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa" returned: 0 in 0.347s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:36 devstack sudo[101587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.info Sep 18 00:45:36 devstack sudo[101587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:36 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 Sep 18 00:45:36 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:36 devstack sudo[101587]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.info" returned: 0 in 0.286s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:36 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.info is being set with open permissions: ugo+rw Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:36 devstack sudo[101593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.info Sep 18 00:45:36 devstack sudo[101593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:36 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:36 devstack sudo[101596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10 Sep 18 00:45:36 devstack sudo[101596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:36 devstack sudo[101593]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.info" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.233s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-e0246692-049e-4508-b463-2bc8dc37068e req-b8dc7921-4799-4359-b0c2-516ef1de2e4f tempest-VolumesSnapshotsTestJSON-1616987172 None] Create snapshot completed successfully Sep 18 00:45:37 devstack sudo[101596]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-09264a8b-3690-406d-aefd-52d0453d9d10" returned: 0 in 0.315s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Lock "cinder-quobyte-09264a8b-3690-406d-aefd-52d0453d9d10" released by "delete_volume" :: held 0.818s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Created reservations ['ca0f67dc-e1bd-4e2b-bf63-f44e095cc567', 'f43bbb0a-cb5d-41af-8671-6e72d4c158e7', 'e2250c15-2b0e-47a4-ac2a-a364a68f63c2', '59507693-7e47-40c7-94d4-59aed3b8a3ca'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "cinder-62014c85-e8f7-45b5-89a9-97d9c268dafa-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-62014c85-e8f7-45b5-89a9-97d9c268dafa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "cinder-quobyte-4d026125-fe86-407c-9062-ad74356ab24d" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-quobyte-4d026125-fe86-407c-9062-ad74356ab24d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "cinder-quobyte-62014c85-e8f7-45b5-89a9-97d9c268dafa" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-quobyte-62014c85-e8f7-45b5-89a9-97d9c268dafa" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Deleting offline snapshot 62014c85-e8f7-45b5-89a9-97d9c268dafa of volume 4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:45:37 devstack sudo[101600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:37 devstack sudo[101600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] snapshot_file for this snap is: volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f74cf15-5d17-4c01-85bd-d82e7db1949f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:37 devstack sudo[101602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa Sep 18 00:45:37 devstack sudo[101602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:37 devstack sudo[101600]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.293s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Deleted volume successfully. Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c86a2b4a-4723-4b82-9efb-e0fb926aac0f tempest-VolumesCloneTest-1482638621 None] Lock "cinder-09264a8b-3690-406d-aefd-52d0453d9d10-delete_volume" released by "delete_volume" :: held 1.377s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:37 devstack sudo[101602]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa" returned: 0 in 0.422s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4d026125-fe86-407c-9062-ad74356ab24d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[46511c51-e988-43db-a68e-096fbf97aaf6]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:37 devstack sudo[101615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d Sep 18 00:45:37 devstack sudo[101615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:38 devstack sudo[101615]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d" returned: 0 in 0.452s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:38 devstack sudo[101625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa Sep 18 00:45:38 devstack sudo[101625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:38 devstack sudo[101625]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa" returned: 0 in 0.462s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-5dc5187b-29da-4e3a-af9d-a3e1bd3ff823 req-1dc81e99-489b-4212-9ab2-576dc23409ea tempest-TestStampPattern-596157518 None] Terminate volume connection completed successfully. Sep 18 00:45:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-5dc5187b-29da-4e3a-af9d-a3e1bd3ff823 req-1dc81e99-489b-4212-9ab2-576dc23409ea tempest-TestStampPattern-596157518 None] Deleting attachment 73114cac-f049-4fce-92de-3830ab4d7bfb. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:45:38 devstack sudo[101659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa Sep 18 00:45:38 devstack sudo[101659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:39 devstack sudo[101659]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d.62014c85-e8f7-45b5-89a9-97d9c268dafa" returned: 0 in 0.294s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-quobyte-62014c85-e8f7-45b5-89a9-97d9c268dafa" released by "_delete_snapshot" :: held 1.784s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-quobyte-4d026125-fe86-407c-9062-ad74356ab24d" released by "delete_snapshot" :: held 1.834s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.quota [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Created reservations ['b9001c7e-9ade-4434-a548-54d7fa7dbe59', 'da54c845-e39a-4ff7-80c8-1f68c8ad0ac9', '01f94346-9156-4df8-a92d-52911d982af2', '0b908fb3-671f-4ac6-974a-b0da4fc9966b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Delete snapshot completed successfully. Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-0593e94c-62f6-4c24-898f-52c72bfb4113 req-ae7dc9fc-0a12-4e6b-9c67-fb90120f4dd0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-62014c85-e8f7-45b5-89a9-97d9c268dafa-delete_snapshot" released by "delete_snapshot" :: held 2.017s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "cinder-4d026125-fe86-407c-9062-ad74356ab24d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-4d026125-fe86-407c-9062-ad74356ab24d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "cinder-quobyte-4d026125-fe86-407c-9062-ad74356ab24d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-quobyte-4d026125-fe86-407c-9062-ad74356ab24d" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b51f70f-72c9-4cbb-a57a-2ddc529eb501]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:39 devstack sudo[101662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d Sep 18 00:45:39 devstack sudo[101662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Creating offline snapshot 098bf870-6cfe-4ae2-a748-dde50c3ab9c4 of volume e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa3c0e8e-baba-4923-9c5d-d9a01183253b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:40 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 Sep 18 00:45:40 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:40 devstack sudo[101662]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d" returned: 0 in 0.423s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:40 devstack sudo[101669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d Sep 18 00:45:40 devstack sudo[101669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:40 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9" returned: 0 in 0.420s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:40 devstack sudo[101674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 1G Sep 18 00:45:40 devstack sudo[101674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:40 devstack sudo[101669]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4d026125-fe86-407c-9062-ad74356ab24d" returned: 0 in 0.303s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-quobyte-4d026125-fe86-407c-9062-ad74356ab24d" released by "delete_volume" :: held 0.817s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG cinder.quota [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Created reservations ['1d401832-428d-414c-a661-3cc4aaa4802f', 'affb6e90-5e24-4730-b8b8-398740ee9f08', '55f93350-8d5f-455f-8456-7670f0d539a5', '4d72a90a-c5b1-4a7b-afee-24865d698a2c'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:40 devstack sudo[101680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:40 devstack sudo[101680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:40 devstack sudo[101674]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 1G" returned: 0 in 0.511s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41b811d-8ce5-405b-b47a-a973513172f9 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:40 devstack sudo[101684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41b811d-8ce5-405b-b47a-a973513172f9 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 Sep 18 00:45:40 devstack sudo[101684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:40 devstack sudo[101680]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.327s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG cinder.manager [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Deleted volume successfully. Sep 18 00:45:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [req-47b88fab-d33d-455b-beeb-045c6117020e req-9899f761-e67e-4b8f-afd9-299bf27cdea0 tempest-VolumesSnapshotsTestJSON-1616987172 None] Lock "cinder-4d026125-fe86-407c-9062-ad74356ab24d-delete_volume" released by "delete_volume" :: held 1.405s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:41 devstack sudo[101684]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e41b811d-8ce5-405b-b47a-a973513172f9 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4" returned: 0 in 0.380s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:41 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 is being set with open permissions: ugo+rw Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:41 devstack sudo[101691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 Sep 18 00:45:41 devstack sudo[101691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:41 devstack sudo[101691]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:41 devstack sudo[101694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.info Sep 18 00:45:41 devstack sudo[101694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:41 devstack sudo[101694]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.info" returned: 0 in 0.303s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:41 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.info is being set with open permissions: ugo+rw Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:41 devstack sudo[101697]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.info Sep 18 00:45:41 devstack sudo[101697]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:45:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Flow 'volume_create_manager' (0ba69913-0952-462c-bcf7-5e1ccb5f168c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2354124-5df4-4d71-bf14-35a8d3709794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d2354124-5df4-4d71-bf14-35a8d3709794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-688377343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839e41a4-cae3-4ba9-a9ae-c5c037be3988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbb2c2e250d451cbd6fedb1eb528c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:42Z,use_quota=True,user_id='0d9a8d9e3b5a46f9834dab6494aa49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ee005f-9073-43fd-a328-b58e45c145b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17ee005f-9073-43fd-a328-b58e45c145b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3373d19a-ed17-409b-8db8-2d3a8c74454b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3373d19a-ed17-409b-8db8-2d3a8c74454b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '839e41a4-cae3-4ba9-a9ae-c5c037be3988', 'volume_name': 'volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988', 'volume_size': 2}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2481a08-3a62-4373-baab-818f486a2a29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2481a08-3a62-4373-baab-818f486a2a29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978e24ce-22d1-42aa-9d78-573e009078eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:42 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Volume 839e41a4-cae3-4ba9-a9ae-c5c037be3988: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988', 'volume_size': 2} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:42 devstack sudo[101697]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.info" returned: 0 in 0.310s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.078s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-688377343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=839e41a4-cae3-4ba9-a9ae-c5c037be3988,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbb2c2e250d451cbd6fedb1eb528c58',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:42Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:42Z,use_quota=True,user_id='0d9a8d9e3b5a46f9834dab6494aa49b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Creating volume 839e41a4-cae3-4ba9-a9ae-c5c037be3988 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:45:42 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 2147483648 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:42 devstack sudo[101700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 2147483648 Sep 18 00:45:42 devstack sudo[101700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c55cc170-5cd6-4884-89dc-38b4268caf3f tempest-TestStampPattern-596157518 None] Create snapshot completed successfully Sep 18 00:45:42 devstack sudo[101700]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 2147483648" returned: 0 in 0.532s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:42 devstack sudo[101706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 Sep 18 00:45:42 devstack sudo[101706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:42 devstack sudo[101706]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988" returned: 0 in 0.271s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.844s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:42 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=81,cinder:UPDATE=97,cinder:INSERT=17,cinder:DELETE=6 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:45:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (978e24ce-22d1-42aa-9d78-573e009078eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988', 'volume_size': 2}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e11e7c-924f-465e-8a12-0c39439ad4d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:43 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Volume volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 (839e41a4-cae3-4ba9-a9ae-c5c037be3988): created successfully Sep 18 00:45:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (12e11e7c-924f-465e-8a12-0c39439ad4d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Flow 'volume_create_manager' (0ba69913-0952-462c-bcf7-5e1ccb5f168c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-79072f72-b0aa-41f3-b729-5b01c531ed73 tempest-VolumesCloneNegativeTest-437609721 None] Created volume successfully. Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Acquiring lock "cinder-839e41a4-cae3-4ba9-a9ae-c5c037be3988-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Lock "cinder-839e41a4-cae3-4ba9-a9ae-c5c037be3988-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Acquiring lock "cinder-quobyte-839e41a4-cae3-4ba9-a9ae-c5c037be3988" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Lock "cinder-quobyte-839e41a4-cae3-4ba9-a9ae-c5c037be3988" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[483ba146-d71e-4c63-98cf-75ed05f14595]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:44 devstack sudo[101709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 Sep 18 00:45:44 devstack sudo[101709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:44 devstack sudo[101709]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988" returned: 0 in 0.399s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:44 devstack sudo[101721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988 Sep 18 00:45:44 devstack sudo[101721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:45 devstack sudo[101721]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-839e41a4-cae3-4ba9-a9ae-c5c037be3988" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Lock "cinder-quobyte-839e41a4-cae3-4ba9-a9ae-c5c037be3988" released by "delete_volume" :: held 0.745s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Created reservations ['5ab2954a-52e2-4a2b-82c7-5e40e183eb96', 'aa1b0cde-146d-4597-b000-64ea4f0f1ac3', 'cb621c2a-d5e0-4173-b07c-82ccb9678666', 'b4e3a412-18a3-4246-b20d-c215b322bc9a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:45 devstack sudo[101734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:45:45 devstack sudo[101734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:45 devstack sudo[101734]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:45:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Deleted volume successfully. Sep 18 00:45:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-24da4181-e3cb-46a8-9485-61571b1e84e9 tempest-VolumesCloneNegativeTest-437609721 None] Lock "cinder-839e41a4-cae3-4ba9-a9ae-c5c037be3988-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:45:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f4f24298-8116-4082-819f-b4c553b125fc tempest-GroupSnapshotsTest-1590475365 None] Group tempest-GroupSnapshotsTest-Group-1061010599: creating Sep 18 00:45:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f4f24298-8116-4082-819f-b4c553b125fc tempest-GroupSnapshotsTest-1590475365 None] Group tempest-GroupSnapshotsTest-Group-1061010599: created successfully Sep 18 00:45:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f4f24298-8116-4082-819f-b4c553b125fc tempest-GroupSnapshotsTest-1590475365 None] Create group completed successfully. Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (95310174-2440-4f64-a777-d9316f173564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa13627-59f2-4c43-be17-280266893469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfa13627-59f2-4c43-be17-280266893469) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-39625383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0265f1fe-22a3-4117-bb6b-fac49c474300,host='devstack@QuobyteHD#QuobyteHD',id=bf4d8534-24c6-4d2f-8c6f-984c332fb73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:47Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c178b5de-dafc-49c1-b608-ad01cb12bb92),volume_type_id=c178b5de-dafc-49c1-b608-ad01cb12bb92)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda2bee0-32b4-4472-9d5f-5c76571ee6d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eda2bee0-32b4-4472-9d5f-5c76571ee6d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40421cf2-f6f0-46b2-9dae-400041eb6e9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40421cf2-f6f0-46b2-9dae-400041eb6e9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bf4d8534-24c6-4d2f-8c6f-984c332fb73b', 'volume_name': 'volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937bd9a0-906f-44d2-9b72-a7b33b4b0a62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (937bd9a0-906f-44d2-9b72-a7b33b4b0a62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce927049-9538-4412-bc86-87d7b169742f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:47 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Volume bf4d8534-24c6-4d2f-8c6f-984c332fb73b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b', 'volume_size': 1} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=0265f1fe-22a3-4117-bb6b-fac49c474300,created_at=2026-09-17T22:45:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-39625383',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=0265f1fe-22a3-4117-bb6b-fac49c474300,host='devstack@QuobyteHD#QuobyteHD',id=bf4d8534-24c6-4d2f-8c6f-984c332fb73b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:47Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c178b5de-dafc-49c1-b608-ad01cb12bb92),volume_type_id=c178b5de-dafc-49c1-b608-ad01cb12bb92)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Creating volume bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:45:47 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:45:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:47 devstack sudo[101745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b 1073741824 Sep 18 00:45:47 devstack sudo[101745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:48 devstack sudo[101745]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b 1073741824" returned: 0 in 0.513s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:48 devstack sudo[101751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b Sep 18 00:45:48 devstack sudo[101751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:48 devstack sudo[101751]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce927049-9538-4412-bc86-87d7b169742f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d823b6c4-363a-4125-a8d6-818a49c26aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:48 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Volume volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b (bf4d8534-24c6-4d2f-8c6f-984c332fb73b): created successfully Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d823b6c4-363a-4125-a8d6-818a49c26aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (95310174-2440-4f64-a777-d9316f173564) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9ccfc533-6f1b-4ec3-a5ab-44bd812a0bb3 tempest-GroupSnapshotsTest-1590475365 None] Created volume successfully. Sep 18 00:45:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] GroupSnapshot a5b944d4-5869-4560-84d9-2d51dd5df17c: creating. Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Group snapshot a5b944d4-5869-4560-84d9-2d51dd5df17c: creating. {{(pid=86526) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Creating offline snapshot b31e651f-ca9b-4bd7-a88d-9110faf28dba of volume bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:45:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5f68b58d-696f-44b4-83d9-cb0b9713f88b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:49 devstack sudo[101754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b Sep 18 00:45:49 devstack sudo[101754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:49 devstack sudo[101754]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" returned: 0 in 0.481s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:49 devstack sudo[101759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba 1G Sep 18 00:45:49 devstack sudo[101759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:49 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:45:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Flow 'volume_create_manager' (e4c326d5-523f-43da-b9ad-4104fc4b9a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cd01e9-e292-4855-85c2-fa884733d689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73cd01e9-e292-4855-85c2-fa884733d689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1885050935',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b96ad6d0-207c-4152-a810-5bfd8391c42a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5b3ad2ce5824197b36be4470d17cb69',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=098bf870-6cfe-4ae2-a748-dde50c3ab9c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:50Z,use_quota=True,user_id='bd77f420d980475eb3c94cb7d6380600',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bf30ff-96a3-4bd8-a98c-ccf2c67ebf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00bf30ff-96a3-4bd8-a98c-ccf2c67ebf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47bebf1-3f58-478f-9204-c1a06c70ae48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c47bebf1-3f58-478f-9204-c1a06c70ae48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'b96ad6d0-207c-4152-a810-5bfd8391c42a', 'volume_name': 'volume-b96ad6d0-207c-4152-a810-5bfd8391c42a', 'volume_size': 1, 'snapshot_id': '098bf870-6cfe-4ae2-a748-dde50c3ab9c4'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88ea411-5fe1-46fa-bd88-3318849cb19c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c88ea411-5fe1-46fa-bd88-3318849cb19c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475c008f-21db-4d4f-8696-cd3a4d8a007f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Volume b96ad6d0-207c-4152-a810-5bfd8391c42a: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-b96ad6d0-207c-4152-a810-5bfd8391c42a', 'volume_size': 1, 'snapshot_id': '098bf870-6cfe-4ae2-a748-dde50c3ab9c4'} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:50 devstack sudo[101759]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba 1G" returned: 0 in 0.588s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:50 devstack sudo[101765]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba Sep 18 00:45:50 devstack sudo[101765]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Flow 'volume_create_manager' (b40a5183-0c8f-4183-9a3f-05b2879e660c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9731eff-de08-41ae-b525-c86632177111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d9731eff-de08-41ae-b525-c86632177111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-84170227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad9b02b-de80-44c4-b5f2-cb3274d1738e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b14d956bed4d1b99017173118e52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:50Z,use_quota=True,user_id='ac48487b8c464a9a846faa7aa0a7a45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fe9a8d-778f-44ff-86e7-8ce1fed89b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98fe9a8d-778f-44ff-86e7-8ce1fed89b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33243de-2643-4e9d-a2ab-5929743a9bda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:45:50 devstack sudo[101765]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba" returned: 0 in 0.363s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:50 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:50 devstack sudo[101770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba Sep 18 00:45:50 devstack sudo[101770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f33243de-2643-4e9d-a2ab-5929743a9bda) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7ad9b02b-de80-44c4-b5f2-cb3274d1738e', 'volume_name': 'volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c43066-483c-4f66-9633-eb0d20fdc746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2c43066-483c-4f66-9633-eb0d20fdc746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd718cc-3a14-4b26-a282-320ee9ee1827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:45:50 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Volume 7ad9b02b-de80-44c4-b5f2-cb3274d1738e: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Trying to clone 7ad9b02b-de80-44c4-b5f2-cb3274d1738e from image 08c75831-54cd-415b-93ab-76883c9da538 at location (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:45:50 devstack sudo[101770]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba" returned: 0 in 0.280s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:50 devstack sudo[101774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.info Sep 18 00:45:50 devstack sudo[101774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:50 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:45:50 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Image download 20.69 MB at 20.69 MB/s Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee83a365-a2be-4a82-a7d8-294de2102eef]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:51 devstack sudo[101774]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.info" returned: 0 in 0.360s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:51 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:51 devstack sudo[101782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.info Sep 18 00:45:51 devstack sudo[101782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:51 devstack sudo[101780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD Sep 18 00:45:51 devstack sudo[101780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:51 devstack sudo[101780]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD" returned: 0 in 0.455s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 is fetched for user ac48487b8c464a9a846faa7aa0a7a45a. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:45:51 devstack sudo[101782]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.info" returned: 0 in 0.372s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.552s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.466s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-quobyte-098bf870-6cfe-4ae2-a748-dde50c3ab9c4-b96ad6d0-207c-4152-a810-5bfd8391c42a" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-098bf870-6cfe-4ae2-a748-dde50c3ab9c4-b96ad6d0-207c-4152-a810-5bfd8391c42a" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Creating volume b96ad6d0-207c-4152-a810-5bfd8391c42a from snapshot 098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-quobyte-b96ad6d0-207c-4152-a810-5bfd8391c42a" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-b96ad6d0-207c-4152-a810-5bfd8391c42a" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] snapshot: 098bf870-6cfe-4ae2-a748-dde50c3ab9c4, volume: b96ad6d0-207c-4152-a810-5bfd8391c42a, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a88e31-e06d-4d82-8a80-17f742e48e55]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:45:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2034e6a1-da31-4811-a424-fc42276431b1 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot a5b944d4-5869-4560-84d9-2d51dd5df17c: created successfully Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f60ad6f-3b42-445f-8b31-14bf1e80eec7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:51 devstack sudo[101793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD Sep 18 00:45:51 devstack sudo[101793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:51 devstack sudo[101798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 Sep 18 00:45:51 devstack sudo[101798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:51 devstack sudo[101793]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD" returned: 0 in 0.357s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:45:52 devstack sudo[101798]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4" returned: 0 in 0.468s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41b811d-8ce5-405b-b47a-a973513172f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2036958a-ba02-4d3d-829c-b30f47fdec27]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:52 devstack sudo[101808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 Sep 18 00:45:52 devstack sudo[101808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:52 devstack sudo[101808]: pam_unix(sudo:session): session closed for user root Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9" returned: 0 in 0.456s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:45:52 devstack sudo[101813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a Sep 18 00:45:52 devstack sudo[101813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:45:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:02 devstack sudo[101813]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a" returned: 0 in 9.485s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9, size 1024.00 MB, duration 9.49 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:46:02 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Converted 1024.00 MB image at 107.95 MB/s Sep 18 00:46:02 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a is being set with open permissions: ugo+rw Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:02 devstack sudo[101895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a Sep 18 00:46:02 devstack sudo[101895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:02 devstack sudo[101895]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-b96ad6d0-207c-4152-a810-5bfd8391c42a" released by "_copy_volume_from_snapshot" :: held 10.837s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-098bf870-6cfe-4ae2-a748-dde50c3ab9c4-b96ad6d0-207c-4152-a810-5bfd8391c42a" released by "_create_volume_from_snapshot" :: held 10.933s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.977s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.510s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:45:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-84170227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ad9b02b-de80-44c4-b5f2-cb3274d1738e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b14d956bed4d1b99017173118e52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:45:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:45:50Z,use_quota=True,user_id='ac48487b8c464a9a846faa7aa0a7a45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Creating volume 7ad9b02b-de80-44c4-b5f2-cb3274d1738e {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:46:02 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:02 devstack sudo[101898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 1073741824 Sep 18 00:46:02 devstack sudo[101898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (475c008f-21db-4d4f-8696-cd3a4d8a007f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b96ad6d0-207c-4152-a810-5bfd8391c42a', 'volume_size': 1, 'snapshot_id': '098bf870-6cfe-4ae2-a748-dde50c3ab9c4'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea57ff89-3daa-498b-af53-a14ea7ace123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:02 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Volume volume-b96ad6d0-207c-4152-a810-5bfd8391c42a (b96ad6d0-207c-4152-a810-5bfd8391c42a): created successfully Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea57ff89-3daa-498b-af53-a14ea7ace123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Flow 'volume_create_manager' (e4c326d5-523f-43da-b9ad-4104fc4b9a93) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:02 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9ac7c9fc-00de-4f80-9b26-9f5da04c91b1 tempest-TestStampPattern-596157518 None] Created volume successfully. Sep 18 00:46:03 devstack sudo[101898]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 1073741824" returned: 0 in 0.548s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:03 devstack sudo[101904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e Sep 18 00:46:03 devstack sudo[101904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:03 devstack sudo[101904]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" returned: 0 in 0.323s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.932s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 10.466s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-b31e651f-ca9b-4bd7-a88d-9110faf28dba-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-b31e651f-ca9b-4bd7-a88d-9110faf28dba-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" acquired by "_create_volume_from_snapshot" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Creating volume 7fbd1379-7dd0-4579-a67d-87b208c4d0e5 from snapshot b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Attempting download of 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume 7ad9b02b-de80-44c4-b5f2-cb3274d1738e. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] snapshot: b31e651f-ca9b-4bd7-a88d-9110faf28dba, volume: 7fbd1379-7dd0-4579-a67d-87b208c4d0e5, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[67b37ba5-87e6-4f3c-be7d-13fd01af65dd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12267ff-496c-4ff5-8b7e-42ef3ec48064]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_l59vzvwc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:03 devstack sudo[101907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba Sep 18 00:46:03 devstack sudo[101907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:03 devstack sudo[101908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_l59vzvwc Sep 18 00:46:03 devstack sudo[101908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:04 devstack sudo[101908]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_l59vzvwc" returned: 0 in 0.402s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_l59vzvwc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:04 devstack sudo[101907]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba" returned: 0 in 0.446s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ceee0ef-e0b7-44f3-84f3-68427d807b3b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:04 devstack sudo[101917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_l59vzvwc Sep 18 00:46:04 devstack sudo[101917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:04 devstack sudo[101918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b Sep 18 00:46:04 devstack sudo[101918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.047s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:04 devstack sudo[101956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:04 devstack sudo[101956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:04 devstack sudo[101917]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_l59vzvwc" returned: 1 in 0.549s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_08c75831-54cd-415b-93ab-76883c9da538_l59vzvwc' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9dcc62f-6bca-461c-9004-b4a123ecf3e3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:04 devstack sudo[101961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD Sep 18 00:46:04 devstack sudo[101961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:04 devstack sudo[101956]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.407s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:46:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:46:05 devstack sudo[101918]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" returned: 0 in 0.955s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:46:05 devstack sudo[101961]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD" returned: 0 in 0.466s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] 08c75831-54cd-415b-93ab-76883c9da538 was qcow2, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:46:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:05 devstack sudo[101972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 Sep 18 00:46:05 devstack sudo[101972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:05 devstack sudo[101974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e Sep 18 00:46:05 devstack sudo[101974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:10 devstack sudo[101974]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" returned: 0 in 5.091s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:10 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_08c75831-54cd-415b-93ab-76883c9da538_c9h84o_idevstack@QuobyteHD, size 112.00 MB, duration 5.09 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:46:10 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Converted 112.00 MB image at 22.00 MB/s Sep 18 00:46:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:10 devstack sudo[101995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 1G Sep 18 00:46:10 devstack sudo[101995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:10 devstack sudo[101995]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 1G" returned: 0 in 0.833s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:10 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Downloaded image 08c75831-54cd-415b-93ab-76883c9da538 ((None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}])) to volume 7ad9b02b-de80-44c4-b5f2-cb3274d1738e successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Temporary image 08c75831-54cd-415b-93ab-76883c9da538 for user ac48487b8c464a9a846faa7aa0a7a45a is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Marking volume 7ad9b02b-de80-44c4-b5f2-cb3274d1738e as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=100,cinder:UPDATE=94,cinder:INSERT=29,cinder:DELETE=10 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Copying metadata from image 08c75831-54cd-415b-93ab-76883c9da538 to 7ad9b02b-de80-44c4-b5f2-cb3274d1738e. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Creating volume glance metadata for volume 7ad9b02b-de80-44c4-b5f2-cb3274d1738e backed by image 08c75831-54cd-415b-93ab-76883c9da538 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dd718cc-3a14-4b26-a282-320ee9ee1827) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e', 'volume_size': 1, 'image_id': '08c75831-54cd-415b-93ab-76883c9da538', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/08c75831-54cd-415b-93ab-76883c9da538', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'd3adb80595924b61ab8d92ee1a6656f7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '08c75831-54cd-415b-93ab-76883c9da538', 'created_at': datetime.datetime(2026, 9, 17, 22, 27, 10, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 27, 12, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/08c75831-54cd-415b-93ab-76883c9da538/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9042ca-44af-4d90-a8a1-466863421609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:11 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Volume volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e (7ad9b02b-de80-44c4-b5f2-cb3274d1738e): created successfully Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b9042ca-44af-4d90-a8a1-466863421609) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Flow 'volume_create_manager' (b40a5183-0c8f-4183-9a3f-05b2879e660c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:11 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4d375832-9d4b-47e5-967f-15bbf7de9080 tempest-VolumesExtendTest-392984198 None] Created volume successfully. Sep 18 00:46:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" returned: 0 in 8.438s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b, size 1024.00 MB, duration 8.44 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:46:13 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Converted 1024.00 MB image at 121.34 MB/s Sep 18 00:46:13 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:13 devstack sudo[102014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 Sep 18 00:46:13 devstack sudo[102014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:13 devstack sudo[102014]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" released by "_copy_volume_from_snapshot" :: held 10.245s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-b31e651f-ca9b-4bd7-a88d-9110faf28dba-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" released by "_create_volume_from_snapshot" :: held 10.365s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.396s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.004s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f066b259-4c54-4cf2-8b3a-f2bfd357e2c0]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2ca56be8-91c2-41e1-84a5-6af9d742c039 tempest-GroupSnapshotsTest-1590475365 None] Create group from source-snapshot-a5b944d4-5869-4560-84d9-2d51dd5df17c completed successfully. Sep 18 00:46:13 devstack sudo[102017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e Sep 18 00:46:13 devstack sudo[102017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:14 devstack sudo[102017]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" returned: 0 in 0.390s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 2G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e 2G" returned: 0 in 0.104s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.521s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-66259fa8-4ffb-4b1d-87d4-ccb3780a136d tempest-VolumesExtendTest-392984198 None] Extend volume completed successfully. Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[343aa27b-59b4-4ebb-ae17-b3a229c88813]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:14 devstack sudo[102026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 Sep 18 00:46:14 devstack sudo[102026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:14 devstack sudo[102026]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:15 devstack sudo[102032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5 Sep 18 00:46:15 devstack sudo[102032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Acquiring lock "cinder-7ad9b02b-de80-44c4-b5f2-cb3274d1738e-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Lock "cinder-7ad9b02b-de80-44c4-b5f2-cb3274d1738e-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:15 devstack sudo[102032]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Acquiring lock "cinder-quobyte-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-7fbd1379-7dd0-4579-a67d-87b208c4d0e5" released by "delete_volume" :: held 0.695s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c3118b8-d58a-4788-ab9d-91403b0156f1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['c20cefde-e1ea-4156-9368-95bcef6acd8d'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:15 devstack cinder-volume[86526]: WARNING cinder.quota [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-54585338 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-54585338, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:15 devstack cinder-volume[86526]: WARNING cinder.quota [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-54585338 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-54585338, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['6e533047-5aed-4e27-923d-a13a087e7bf4', '2d55135d-0606-46cd-872e-282be49dfb64', '1801f34d-e859-4e17-b0c7-a60e3fd5ac16', 'c91b0eb1-2192-40eb-a1e9-1c3a1a36dddf'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:15 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e Sep 18 00:46:15 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:15 devstack sudo[102037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:15 devstack sudo[102037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:15 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" returned: 0 in 0.375s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:15 devstack sudo[102042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e Sep 18 00:46:15 devstack sudo[102042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:15 devstack sudo[102037]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.274s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3d39a52e-da73-47db-927d-d4361fcbc0b9 tempest-GroupSnapshotsTest-1590475365 None] Delete group completed successfully. Sep 18 00:46:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot a5b944d4-5869-4560-84d9-2d51dd5df17c: deleting Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot a5b944d4-5869-4560-84d9-2d51dd5df17c: deleting {{(pid=86526) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-b31e651f-ca9b-4bd7-a88d-9110faf28dba" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-b31e651f-ca9b-4bd7-a88d-9110faf28dba" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Deleting offline snapshot b31e651f-ca9b-4bd7-a88d-9110faf28dba of volume bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] snapshot_file for this snap is: volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a91e189-14ea-4069-b9fd-287a9af4eaa8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:15 devstack sudo[102042]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-7ad9b02b-de80-44c4-b5f2-cb3274d1738e" released by "delete_volume" :: held 0.694s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Created reservations ['faebb63d-18c5-41ce-966d-339f92f0a017', 'beae4f85-5c5e-4304-90c1-391d6982be9d', '3a4d8bc7-0708-432f-82ff-ac49ea12f208', '3631f30b-fb77-4813-87c0-5f36680bddcb'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:16 devstack sudo[102046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba Sep 18 00:46:16 devstack sudo[102046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:16 devstack sudo[102048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:16 devstack sudo[102048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:16 devstack sudo[102046]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:16 devstack sudo[102048]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.277s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Deleted volume successfully. Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d84be6-6f77-401e-a043-b547c6fe117e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-80af4f19-4e07-42ab-8d32-8e7b7825b315 tempest-VolumesExtendTest-392984198 None] Lock "cinder-7ad9b02b-de80-44c4-b5f2-cb3274d1738e-delete_volume" released by "delete_volume" :: held 1.206s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:16 devstack sudo[102054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b Sep 18 00:46:16 devstack sudo[102054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Flow 'volume_create_manager' (e5730909-17ff-40c4-81d7-c8c5c36cf9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd5fb7-f51c-4a17-8b9b-1cbc03ed1b53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60dd5fb7-f51c-4a17-8b9b-1cbc03ed1b53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1783051117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc4e3f-c1d9-477c-b198-3de24c0c0e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b14d956bed4d1b99017173118e52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:17Z,use_quota=True,user_id='ac48487b8c464a9a846faa7aa0a7a45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9f0532-6094-4aa5-b1c7-a2e28e6fd1cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cb9f0532-6094-4aa5-b1c7-a2e28e6fd1cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15e87b6-464c-4c74-a4a2-69bf208aef4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f15e87b6-464c-4c74-a4a2-69bf208aef4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bbfc4e3f-c1d9-477c-b198-3de24c0c0e03', 'volume_name': 'volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2deb3e-e78b-48ca-b88e-ae67dde01da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8c2deb3e-e78b-48ca-b88e-ae67dde01da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7162e2-4ee0-429f-b366-408128104f1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Volume bbfc4e3f-c1d9-477c-b198-3de24c0c0e03: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03', 'volume_size': 1} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:46:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1783051117',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bbfc4e3f-c1d9-477c-b198-3de24c0c0e03,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='54b14d956bed4d1b99017173118e52c4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:17Z,use_quota=True,user_id='ac48487b8c464a9a846faa7aa0a7a45a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Creating volume bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:16 devstack sudo[102054]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:46:16 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:46:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" returned: 0 in 0.604s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:17 devstack sudo[102059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 1073741824 Sep 18 00:46:17 devstack sudo[102059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:17 devstack sudo[102060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba Sep 18 00:46:17 devstack sudo[102060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:17 devstack sudo[102060]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba" returned: 0 in 0.361s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:17 devstack sudo[102070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba Sep 18 00:46:17 devstack sudo[102070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:17 devstack sudo[102059]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 1073741824" returned: 0 in 0.466s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:17 devstack sudo[102072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 Sep 18 00:46:17 devstack sudo[102072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:17 devstack sudo[102070]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b.b31e651f-ca9b-4bd7-a88d-9110faf28dba" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-b31e651f-ca9b-4bd7-a88d-9110faf28dba" released by "_delete_snapshot" :: held 1.762s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" released by "delete_snapshot" :: held 1.786s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:17 devstack sudo[102072]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.781s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f7162e2-4ee0-429f-b366-408128104f1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ce259b-783c-46d8-9070-0c8742bb9a11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Volume volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 (bbfc4e3f-c1d9-477c-b198-3de24c0c0e03): created successfully Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (27ce259b-783c-46d8-9070-0c8742bb9a11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Flow 'volume_create_manager' (e5730909-17ff-40c4-81d7-c8c5c36cf9c6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:17 devstack cinder-volume[86526]: WARNING cinder.quota [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-54585338 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-54585338, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f1fa3078-fc7d-47aa-8867-10311813a3ae tempest-VolumesExtendTest-392984198 None] Created volume successfully. Sep 18 00:46:17 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['4bd13dd1-5681-4d52-b362-c39b07097209', 'afec3afd-30d8-44ff-b436-2f9247c41978', 'bc5e2c48-3b55-40b5-bca3-c87c4da584e7', '85567e52-74e8-493f-a165-2f4461b14fbf'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-865ec334-d899-4512-8e77-8a6e9d9537b6 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot a5b944d4-5869-4560-84d9-2d51dd5df17c: deleted successfully Sep 18 00:46:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:18 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d49a4d56-dd4e-4d2f-a900-daa3d30fb691]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:18 devstack sudo[102076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b Sep 18 00:46:18 devstack sudo[102076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:18 devstack sudo[102076]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" returned: 0 in 0.362s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:18 devstack sudo[102081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b Sep 18 00:46:18 devstack sudo[102081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:19 devstack sudo[102081]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-bf4d8534-24c6-4d2f-8c6f-984c332fb73b" released by "delete_volume" :: held 0.720s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Creating offline snapshot faae8aeb-f725-490e-b213-5af6c8bae27e of volume bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[91b1b0fc-be62-4937-ab6c-2ce3887b6f8e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['166c6847-454c-4286-94c3-70b2dcd80986'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:19 devstack cinder-volume[86526]: WARNING cinder.db.api [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-54585338'] Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['d505363c-0635-44a7-bba0-fc6905720d70', '3e238e9e-9ff4-4567-8103-123a4e53f7ec', '23d5ca9f-71e2-477d-a79c-f802a39a83e9', '383fca33-c529-4f72-a749-e59b14311500'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:19 devstack sudo[102084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 Sep 18 00:46:19 devstack sudo[102084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:19 devstack sudo[102086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:19 devstack sudo[102086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:19 devstack sudo[102084]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" returned: 0 in 0.392s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:19 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e 1G Sep 18 00:46:19 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:19 devstack sudo[102086]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.278s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:19 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f31f2128-67af-4815-8811-9c979d4dd686 tempest-GroupSnapshotsTest-1590475365 None] Delete group completed successfully. Sep 18 00:46:20 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e 1G" returned: 0 in 0.462s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-52edf915-43c9-4f1f-9f30-b65c098086e1 tempest-GroupSnapshotsTest-1590475365 None] Group tempest-GroupSnapshotsTest-Group-1462012395: creating Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:20 devstack sudo[102098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e Sep 18 00:46:20 devstack sudo[102098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-52edf915-43c9-4f1f-9f30-b65c098086e1 tempest-GroupSnapshotsTest-1590475365 None] Group tempest-GroupSnapshotsTest-Group-1462012395: created successfully Sep 18 00:46:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-52edf915-43c9-4f1f-9f30-b65c098086e1 tempest-GroupSnapshotsTest-1590475365 None] Create group completed successfully. Sep 18 00:46:20 devstack sudo[102098]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e" returned: 0 in 0.294s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:20 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e is being set with open permissions: ugo+rw Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:20 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e Sep 18 00:46:20 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:20 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e" returned: 0 in 0.242s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:20 devstack sudo[102106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.info Sep 18 00:46:20 devstack sudo[102106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:20 devstack sudo[102106]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.info" returned: 0 in 0.247s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:20 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.info is being set with open permissions: ugo+rw Sep 18 00:46:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:20 devstack sudo[102110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.info Sep 18 00:46:20 devstack sudo[102110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:21 devstack sudo[102110]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.info" returned: 0 in 0.248s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.989s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2000f811-3f35-43d5-b5ca-41f37200df47 tempest-VolumesExtendTest-392984198 None] Create snapshot completed successfully Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (f0a0c0b0-2145-440c-9647-780090dc18a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0d7a27-9fa9-4a20-a7b9-44a007f21a49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0d7a27-9fa9-4a20-a7b9-44a007f21a49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143240497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b579dc45-a02a-494e-9a11-d5f5336cc998,host='devstack@QuobyteHD#QuobyteHD',id=949322d8-a02c-4118-a275-fa894436a1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:22Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed07976c-0918-45c4-9b7b-a08a8ecab161),volume_type_id=ed07976c-0918-45c4-9b7b-a08a8ecab161)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e46d51f-7003-4d5e-b77f-fb7d1f0c2e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e46d51f-7003-4d5e-b77f-fb7d1f0c2e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002d49ba-304c-4140-8d85-1c53cc51e783) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (002d49ba-304c-4140-8d85-1c53cc51e783) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '949322d8-a02c-4118-a275-fa894436a1ca', 'volume_name': 'volume-949322d8-a02c-4118-a275-fa894436a1ca', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77deb9b0-08c2-419b-801d-a7e469d2194f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (77deb9b0-08c2-419b-801d-a7e469d2194f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4a18f5-ebd5-423a-82a0-c56be1bdb4cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Volume 949322d8-a02c-4118-a275-fa894436a1ca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-949322d8-a02c-4118-a275-fa894436a1ca', 'volume_size': 1} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b579dc45-a02a-494e-9a11-d5f5336cc998,created_at=2026-09-17T22:46:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-143240497',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b579dc45-a02a-494e-9a11-d5f5336cc998,host='devstack@QuobyteHD#QuobyteHD',id=949322d8-a02c-4118-a275-fa894436a1ca,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:22Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed07976c-0918-45c4-9b7b-a08a8ecab161),volume_type_id=ed07976c-0918-45c4-9b7b-a08a8ecab161)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Creating volume 949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:46:21 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:46:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:21 devstack sudo[102113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca 1073741824 Sep 18 00:46:21 devstack sudo[102113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:22 devstack sudo[102113]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca 1073741824" returned: 0 in 0.420s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:22 devstack sudo[102118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca Sep 18 00:46:22 devstack sudo[102118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:22 devstack sudo[102118]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] <== create_volume: return (722ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.724s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.043s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d4a18f5-ebd5-423a-82a0-c56be1bdb4cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-949322d8-a02c-4118-a275-fa894436a1ca', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2053a528-a31b-4a3d-b597-f6c101d86419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8927b54-0406-499b-8cf7-6d51fddd6370]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Volume volume-949322d8-a02c-4118-a275-fa894436a1ca (949322d8-a02c-4118-a275-fa894436a1ca): created successfully Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2053a528-a31b-4a3d-b597-f6c101d86419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (f0a0c0b0-2145-440c-9647-780090dc18a7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-92219135-95e7-40bc-b860-66017fa877be tempest-GroupSnapshotsTest-1590475365 None] Created volume successfully. Sep 18 00:46:22 devstack sudo[102121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 Sep 18 00:46:22 devstack sudo[102121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:22 devstack sudo[102121]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" returned: 0 in 0.377s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e 2G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e 2G" returned: 0 in 0.136s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.559s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-aac6aa64-27a9-4f08-9550-a24eb8785a08 tempest-VolumesExtendTest-392984198 None] Extend volume completed successfully. Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (6af0e327-1792-4273-a3a1-2d21d35cb4ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1630c546-aeb4-4a5b-980d-fd699a60ea44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1630c546-aeb4-4a5b-980d-fd699a60ea44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587606900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b579dc45-a02a-494e-9a11-d5f5336cc998,host='devstack@QuobyteHD#QuobyteHD',id=592af119-632b-43df-bc97-01cef7a7e5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:23Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed07976c-0918-45c4-9b7b-a08a8ecab161),volume_type_id=ed07976c-0918-45c4-9b7b-a08a8ecab161)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592bdf81-feda-40d1-b9a2-e3660ddca172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (592bdf81-feda-40d1-b9a2-e3660ddca172) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9639642d-c13c-4bdd-a4d4-59aecfb49264) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9639642d-c13c-4bdd-a4d4-59aecfb49264) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '592af119-632b-43df-bc97-01cef7a7e5bd', 'volume_name': 'volume-592af119-632b-43df-bc97-01cef7a7e5bd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a29406-3bd9-41f8-b19d-991d3cea64d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9a29406-3bd9-41f8-b19d-991d3cea64d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4111bd4b-9254-4d5d-a93f-da0c861c42ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Volume 592af119-632b-43df-bc97-01cef7a7e5bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-592af119-632b-43df-bc97-01cef7a7e5bd', 'volume_size': 1} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=b579dc45-a02a-494e-9a11-d5f5336cc998,created_at=2026-09-17T22:46:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1587606900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=b579dc45-a02a-494e-9a11-d5f5336cc998,host='devstack@QuobyteHD#QuobyteHD',id=592af119-632b-43df-bc97-01cef7a7e5bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:23Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ed07976c-0918-45c4-9b7b-a08a8ecab161),volume_type_id=ed07976c-0918-45c4-9b7b-a08a8ecab161)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Creating volume 592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:46:23 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:23 devstack sudo[102129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd 1073741824 Sep 18 00:46:23 devstack sudo[102129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Acquiring lock "cinder-faae8aeb-f725-490e-b213-5af6c8bae27e-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Lock "cinder-faae8aeb-f725-490e-b213-5af6c8bae27e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Acquiring lock "cinder-quobyte-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Acquiring lock "cinder-quobyte-faae8aeb-f725-490e-b213-5af6c8bae27e" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-faae8aeb-f725-490e-b213-5af6c8bae27e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Deleting offline snapshot faae8aeb-f725-490e-b213-5af6c8bae27e of volume bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] snapshot_file for this snap is: volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ebdf7aa-25c2-4aa6-a903-3f86d690fd0a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:23 devstack sudo[102134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e Sep 18 00:46:23 devstack sudo[102134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:23 devstack sudo[102129]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd 1073741824" returned: 0 in 0.431s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:23 devstack sudo[102137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd Sep 18 00:46:23 devstack sudo[102137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:24 devstack sudo[102134]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e" returned: 0 in 0.411s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea19590c-d786-418d-ba57-7f6d93eb5dcc]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:24 devstack sudo[102137]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4111bd4b-9254-4d5d-a93f-da0c861c42ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-592af119-632b-43df-bc97-01cef7a7e5bd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cac414-8837-445d-8292-6a7849fb13c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:24 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Volume volume-592af119-632b-43df-bc97-01cef7a7e5bd (592af119-632b-43df-bc97-01cef7a7e5bd): created successfully Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86cac414-8837-445d-8292-6a7849fb13c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (6af0e327-1792-4273-a3a1-2d21d35cb4ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9da1b6a0-9d4f-40d7-999e-402b024da984 tempest-GroupSnapshotsTest-1590475365 None] Created volume successfully. Sep 18 00:46:24 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 Sep 18 00:46:24 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:24 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" returned: 0 in 0.373s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:24 devstack sudo[102148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e Sep 18 00:46:24 devstack sudo[102148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b9de0894-ea80-494d-a211-64bb39884994 tempest-GroupSnapshotsTest-1590475365 None] Update group completed successfully. Sep 18 00:46:24 devstack sudo[102148]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:24 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e Sep 18 00:46:24 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:25 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03.faae8aeb-f725-490e-b213-5af6c8bae27e" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-faae8aeb-f725-490e-b213-5af6c8bae27e" released by "_delete_snapshot" :: held 1.575s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" released by "delete_snapshot" :: held 1.600s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Created reservations ['ac41d76d-361a-4153-9851-ae441ea9a616', 'c970fdf3-e007-4bd3-88c5-bfc3832c4385', 'bec95b1e-0c02-46dd-9a70-839bb87da99c', 'def1c63a-7066-4a1e-b888-07f3c6412d2d'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Delete snapshot completed successfully. Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-49ee83c5-5e9f-4127-b268-46513ca9298d tempest-VolumesExtendTest-392984198 None] Lock "cinder-faae8aeb-f725-490e-b213-5af6c8bae27e-delete_snapshot" released by "delete_snapshot" :: held 1.764s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Acquiring lock "cinder-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Lock "cinder-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-58c9b99f-61cc-40d1-b59d-f7b3f05e2e2b tempest-GroupSnapshotsTest-1590475365 None] Update group completed successfully. Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Acquiring lock "cinder-quobyte-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b4fb01e-eb43-4580-8fb1-c0ca81e89a5f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:26 devstack sudo[102157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 Sep 18 00:46:26 devstack sudo[102157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:26 devstack sudo[102157]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" returned: 0 in 0.364s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:26 devstack sudo[102162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03 Sep 18 00:46:26 devstack sudo[102162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:26 devstack sudo[102162]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Lock "cinder-quobyte-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03" released by "delete_volume" :: held 0.692s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Created reservations ['5aeb4c13-f3cc-4157-839f-9c5f0d9d2c39', '83efc80e-1cbe-4649-afce-db3ab1c366c2', '925d4690-b96b-4420-aa78-7c5f716ad868', '43e0e98d-bae6-4db0-a289-8cb4a59b4501'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:26 devstack sudo[102165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:26 devstack sudo[102165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:26 devstack sudo[102165]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.304s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:26 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Deleted volume successfully. Sep 18 00:46:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ae17733b-c421-4f1c-b133-f8f71adb09fd tempest-VolumesExtendTest-392984198 None] Lock "cinder-bbfc4e3f-c1d9-477c-b198-3de24c0c0e03-delete_volume" released by "delete_volume" :: held 1.207s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a491526d-e344-4aca-b7f6-f2f58ebd7408 tempest-GroupSnapshotsTest-1590475365 None] Update group completed successfully. Sep 18 00:46:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-21f1331d-f7ea-4897-a54b-c50a1a93a438 tempest-GroupSnapshotsTest-1590475365 None] Update group completed successfully. Sep 18 00:46:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] GroupSnapshot f360ec7e-4c79-4cca-ad9b-68576e9b12e6: creating. Sep 18 00:46:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Group snapshot f360ec7e-4c79-4cca-ad9b-68576e9b12e6: creating. {{(pid=86526) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 00:46:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Creating offline snapshot 26f999e8-538e-4871-aebe-417cd70c0aa6 of volume 592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:46:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d164db20-0b2a-4e3d-8fa6-180969e291ec]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:29 devstack sudo[102169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd Sep 18 00:46:29 devstack sudo[102169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:30 devstack sudo[102169]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd" returned: 0 in 0.376s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:30 devstack sudo[102175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 1G Sep 18 00:46:30 devstack sudo[102175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:30 devstack sudo[102175]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 1G" returned: 0 in 0.444s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592af119-632b-43df-bc97-01cef7a7e5bd -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:30 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592af119-632b-43df-bc97-01cef7a7e5bd -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 Sep 18 00:46:30 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Flow 'volume_create_manager' (c5463a46-d9c5-4a00-a027-6fe6eaf56004) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c79619c-c1ef-4e44-b878-31027e7736b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c79619c-c1ef-4e44-b878-31027e7736b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1704292445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7bcbab-179a-481f-82e0-bee48c73126b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0dd6c26d984c968ac8422354c5465d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:31Z,use_quota=True,user_id='b16b119ec5804f83bbdb70f17ddf2e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f31c14-dd15-44e9-aec0-6a2d799c4c2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50f31c14-dd15-44e9-aec0-6a2d799c4c2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6041e0-5111-4867-b1c7-021bc3113ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1e6041e0-5111-4867-b1c7-021bc3113ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ff7bcbab-179a-481f-82e0-bee48c73126b', 'volume_name': 'volume-ff7bcbab-179a-481f-82e0-bee48c73126b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a07b3ba-2913-439b-8100-f55450ac2d71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a07b3ba-2913-439b-8100-f55450ac2d71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178ee7d1-3a28-4a59-a71a-55597b6ac0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:30 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Volume ff7bcbab-179a-481f-82e0-bee48c73126b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ff7bcbab-179a-481f-82e0-bee48c73126b', 'volume_size': 1} Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:30 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-592af119-632b-43df-bc97-01cef7a7e5bd -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:30 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:46:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:30 devstack sudo[102187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 Sep 18 00:46:30 devstack sudo[102187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:31 devstack sudo[102187]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6" returned: 0 in 0.242s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:31 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.info Sep 18 00:46:31 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:31 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.info" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:31 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:31 devstack sudo[102193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.info Sep 18 00:46:31 devstack sudo[102193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:31 devstack sudo[102193]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.info" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.938s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Creating offline snapshot ff748c5d-ac1c-4e16-9cf2-210054156451 of volume 949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cadb88-50b3-4bc5-946c-e1d8812c971d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:31 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca Sep 18 00:46:31 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:32 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca" returned: 0 in 0.356s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:32 devstack sudo[102201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 1G Sep 18 00:46:32 devstack sudo[102201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:32 devstack sudo[102201]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 1G" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949322d8-a02c-4118-a275-fa894436a1ca -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:32 devstack sudo[102207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949322d8-a02c-4118-a275-fa894436a1ca -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 Sep 18 00:46:32 devstack sudo[102207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:32 devstack sudo[102207]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-949322d8-a02c-4118-a275-fa894436a1ca -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451" returned: 0 in 0.287s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:32 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:46:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:32 devstack sudo[102213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 Sep 18 00:46:32 devstack sudo[102213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:32 devstack sudo[102213]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451" returned: 0 in 0.252s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:33 devstack sudo[102216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.info Sep 18 00:46:33 devstack sudo[102216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:33 devstack sudo[102216]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.info" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:33 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:33 devstack sudo[102219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.info Sep 18 00:46:33 devstack sudo[102219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:33 devstack sudo[102219]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.info" returned: 0 in 0.241s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.871s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.841s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1704292445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ff7bcbab-179a-481f-82e0-bee48c73126b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7e0dd6c26d984c968ac8422354c5465d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:31Z,use_quota=True,user_id='b16b119ec5804f83bbdb70f17ddf2e0b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Creating volume ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:46:33 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:33 devstack sudo[102222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b 1073741824 Sep 18 00:46:33 devstack sudo[102222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b66eb5e0-5454-40f4-9be3-486a0a3fbfc1 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot f360ec7e-4c79-4cca-ad9b-68576e9b12e6: created successfully Sep 18 00:46:33 devstack sudo[102222]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b 1073741824" returned: 0 in 0.444s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:34 devstack sudo[102228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b Sep 18 00:46:34 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot f360ec7e-4c79-4cca-ad9b-68576e9b12e6: deleting Sep 18 00:46:34 devstack sudo[102228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot f360ec7e-4c79-4cca-ad9b-68576e9b12e6: deleting {{(pid=86526) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-592af119-632b-43df-bc97-01cef7a7e5bd" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-592af119-632b-43df-bc97-01cef7a7e5bd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-26f999e8-538e-4871-aebe-417cd70c0aa6" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-26f999e8-538e-4871-aebe-417cd70c0aa6" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Deleting offline snapshot 26f999e8-538e-4871-aebe-417cd70c0aa6 of volume 592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] snapshot_file for this snap is: volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[da697cb3-0dd8-4bb0-8599-9a67db8f953e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:34 devstack sudo[102228]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b" returned: 0 in 0.272s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] <== create_volume: return (757ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:34 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (178ee7d1-3a28-4a59-a71a-55597b6ac0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ff7bcbab-179a-481f-82e0-bee48c73126b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:34 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4f2543-34dd-4045-af1f-0ee3f71a0089) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Volume volume-ff7bcbab-179a-481f-82e0-bee48c73126b (ff7bcbab-179a-481f-82e0-bee48c73126b): created successfully Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b4f2543-34dd-4045-af1f-0ee3f71a0089) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Flow 'volume_create_manager' (c5463a46-d9c5-4a00-a027-6fe6eaf56004) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:34 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a93c615c-1313-4187-964d-42173a15d244 tempest-VolumesSnapshotListTestJSON-279304238 None] Created volume successfully. Sep 18 00:46:34 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6" returned: 0 in 0.380s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-592af119-632b-43df-bc97-01cef7a7e5bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6143aea4-729c-4ccc-aeac-b5ec432f7bd1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:34 devstack sudo[102236]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd Sep 18 00:46:34 devstack sudo[102236]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Creating offline snapshot 1d5fe8d5-d2ee-4977-a922-1f51996adb34 of volume ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:46:34 devstack sudo[102236]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[759db2cd-0be6-45eb-a8ff-9d28aa08a5cf]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:35 devstack sudo[102241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 Sep 18 00:46:35 devstack sudo[102241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:35 devstack sudo[102242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b Sep 18 00:46:35 devstack sudo[102242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:35 devstack sudo[102241]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6" returned: 0 in 0.351s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:35 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6 Sep 18 00:46:35 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:35 devstack sudo[102242]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b" returned: 0 in 0.419s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:35 devstack sudo[102253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 1G Sep 18 00:46:35 devstack sudo[102253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:35 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd.26f999e8-538e-4871-aebe-417cd70c0aa6" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-26f999e8-538e-4871-aebe-417cd70c0aa6" released by "_delete_snapshot" :: held 1.503s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-592af119-632b-43df-bc97-01cef7a7e5bd" released by "delete_snapshot" :: held 1.537s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-949322d8-a02c-4118-a275-fa894436a1ca" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-949322d8-a02c-4118-a275-fa894436a1ca" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-ff748c5d-ac1c-4e16-9cf2-210054156451" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-ff748c5d-ac1c-4e16-9cf2-210054156451" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Deleting offline snapshot ff748c5d-ac1c-4e16-9cf2-210054156451 of volume 949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] snapshot_file for this snap is: volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[595155e5-1c75-457e-a7ba-c6052e0db7a5]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:35 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 Sep 18 00:46:35 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:35 devstack sudo[102253]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 1G" returned: 0 in 0.429s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:35 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 Sep 18 00:46:35 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:36 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451" returned: 0 in 0.380s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-949322d8-a02c-4118-a275-fa894436a1ca(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5750d54-7892-4987-9641-9a458f1224e5]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:36 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34" returned: 0 in 0.315s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:36 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 is being set with open permissions: ugo+rw Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:36 devstack sudo[102272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 Sep 18 00:46:36 devstack sudo[102272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:36 devstack sudo[102271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca Sep 18 00:46:36 devstack sudo[102271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:36 devstack sudo[102272]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34" returned: 0 in 0.255s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:36 devstack sudo[102279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.info Sep 18 00:46:36 devstack sudo[102279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:36 devstack sudo[102271]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca" returned: 0 in 0.365s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:36 devstack sudo[102281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 Sep 18 00:46:36 devstack sudo[102281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:36 devstack sudo[102279]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.info" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:36 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.info is being set with open permissions: ugo+rw Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:36 devstack sudo[102285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.info Sep 18 00:46:36 devstack sudo[102285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:36 devstack sudo[102281]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451" returned: 0 in 0.347s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:36 devstack sudo[102289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451 Sep 18 00:46:36 devstack sudo[102289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:36 devstack sudo[102285]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.info" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-394d4209-9b38-4a94-8931-6aa2f1550aaa tempest-VolumesSnapshotListTestJSON-279304238 None] Create snapshot completed successfully Sep 18 00:46:37 devstack sudo[102289]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca.ff748c5d-ac1c-4e16-9cf2-210054156451" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-ff748c5d-ac1c-4e16-9cf2-210054156451" released by "_delete_snapshot" :: held 1.458s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-949322d8-a02c-4118-a275-fa894436a1ca" released by "delete_snapshot" :: held 1.479s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:37 devstack cinder-volume[86526]: WARNING cinder.quota [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2138365701 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2138365701, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:37 devstack cinder-volume[86526]: WARNING cinder.quota [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2138365701 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2138365701, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['920008f7-a0c8-4859-88ed-f35afd1e0b07', '75a07889-643a-43c3-92a4-c34bba747924', '626838e5-d194-4204-a24e-8780cc330ded', 'fc9339fc-4c94-43e9-92ec-15f17fa6ed11'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['58a2a3f7-365c-40cb-9655-48d4cd035b65', '9dc65522-9aaf-464f-b0a9-ef9d6a165bc7', 'c25c2080-0d88-4729-b62d-1d7a274ef53c', '655d7a74-c1ea-46a2-84e5-889d41641e86'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-988b45be-4b52-4784-bdcd-07b50d7e5110 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot f360ec7e-4c79-4cca-ad9b-68576e9b12e6: deleted successfully Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-592af119-632b-43df-bc97-01cef7a7e5bd" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-592af119-632b-43df-bc97-01cef7a7e5bd" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[70ab0728-dcec-4254-a014-a776674aa03c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:38 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd Sep 18 00:46:38 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Creating offline snapshot 05161704-bcae-4071-bf2a-5a7314a376de of volume ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:46:38 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[80dcec7e-cb20-4584-9783-2b425d84e21c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:38 devstack sudo[102298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd Sep 18 00:46:38 devstack sudo[102298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:38 devstack sudo[102299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 Sep 18 00:46:38 devstack sudo[102299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:38 devstack sudo[102298]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-592af119-632b-43df-bc97-01cef7a7e5bd" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-592af119-632b-43df-bc97-01cef7a7e5bd" released by "delete_volume" :: held 0.748s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-949322d8-a02c-4118-a275-fa894436a1ca" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-949322d8-a02c-4118-a275-fa894436a1ca" acquired by "delete_volume" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c54ab7-a3dc-48e6-a5bd-86fe468e10f7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:38 devstack sudo[102299]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34" returned: 0 in 0.391s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7bcbab-179a-481f-82e0-bee48c73126b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:38 devstack sudo[102309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de 1G Sep 18 00:46:38 devstack sudo[102309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:38 devstack sudo[102307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca Sep 18 00:46:38 devstack sudo[102307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:39 devstack sudo[102307]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca" returned: 0 in 0.387s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:39 devstack sudo[102318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca Sep 18 00:46:39 devstack sudo[102318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:39 devstack sudo[102309]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de 1G" returned: 0 in 0.497s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:39 devstack sudo[102320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de Sep 18 00:46:39 devstack sudo[102320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:39 devstack sudo[102318]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-949322d8-a02c-4118-a275-fa894436a1ca" returned: 0 in 0.282s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-949322d8-a02c-4118-a275-fa894436a1ca" released by "delete_volume" :: held 0.741s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['03774963-9966-482b-8c6e-bad38d15b404'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:39 devstack cinder-volume[86526]: WARNING cinder.quota [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2138365701 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2138365701, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['1c650bff-3ecf-4bc0-a12b-935d43bc51cb', '096c89b1-80f7-48f8-a231-0cc9866201b5', '07baeec6-9b5a-45e2-94cb-53369c2b6f88', 'be01ba9c-ea73-4d71-880e-b2d20efd17ee'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:39 devstack sudo[102320]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de" returned: 0 in 0.315s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:39 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de is being set with open permissions: ugo+rw Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:39 devstack sudo[102327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de Sep 18 00:46:39 devstack sudo[102327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['2a565e8f-330d-46eb-8011-1870c08989ba', '3011c74e-e2c2-4c6f-b261-8553727ff121', '4f0e1250-314d-463a-b94a-ae94aa2ff123', '029bbfaa-52e6-4371-a262-6215ddcf231c'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:39 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:39 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:39 devstack sudo[102327]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de" returned: 0 in 0.255s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.569s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2795134c-845b-4604-a49c-acb46519dbd3 tempest-VolumesSnapshotListTestJSON-279304238 None] Create snapshot completed successfully Sep 18 00:46:39 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.255s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:39 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8789c696-c1a4-48b8-a4b3-3a0bb0bdd619 tempest-GroupSnapshotsTest-1590475365 None] Delete group completed successfully. Sep 18 00:46:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Creating offline snapshot 4b0fb0ba-ec06-4d8d-a1f2-2807db357156 of volume ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:46:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d318cc3-e0d3-431e-95f5-8bbf18c9e87a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c9d5c126-4540-4de6-a3b4-882f52febb47 tempest-GroupSnapshotsTest-1590475365 None] Group tempest-GroupSnapshotsTest-Group-2146163813: creating Sep 18 00:46:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c9d5c126-4540-4de6-a3b4-882f52febb47 tempest-GroupSnapshotsTest-1590475365 None] Group tempest-GroupSnapshotsTest-Group-2146163813: created successfully Sep 18 00:46:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c9d5c126-4540-4de6-a3b4-882f52febb47 tempest-GroupSnapshotsTest-1590475365 None] Create group completed successfully. Sep 18 00:46:40 devstack sudo[102333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de Sep 18 00:46:40 devstack sudo[102333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:41 devstack sudo[102333]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de" returned: 0 in 0.380s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7bcbab-179a-481f-82e0-bee48c73126b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:41 devstack sudo[102343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 1G Sep 18 00:46:41 devstack sudo[102343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:41 devstack sudo[102343]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 1G" returned: 0 in 0.571s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:41 devstack sudo[102355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 Sep 18 00:46:41 devstack sudo[102355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-c450e2c0-6b06-4bc6-9cf3-e07202c83ee4 req-80f31a37-dff1-4594-a77f-518bbd57094e tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:41 devstack sudo[102355]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156" returned: 0 in 0.302s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:41 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 is being set with open permissions: ugo+rw Sep 18 00:46:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:41 devstack sudo[102366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 Sep 18 00:46:41 devstack sudo[102366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:42 devstack sudo[102366]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156" returned: 0 in 0.270s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.656s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-c450e2c0-6b06-4bc6-9cf3-e07202c83ee4 req-80f31a37-dff1-4594-a77f-518bbd57094e tempest-TestStampPattern-596157518 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.413s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-c450e2c0-6b06-4bc6-9cf3-e07202c83ee4 req-80f31a37-dff1-4594-a77f-518bbd57094e tempest-TestStampPattern-596157518 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b5818bdd-202c-48c9-84f5-a2d8e8ed4439 tempest-VolumesSnapshotListTestJSON-279304238 None] Create snapshot completed successfully Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-c450e2c0-6b06-4bc6-9cf3-e07202c83ee4 req-80f31a37-dff1-4594-a77f-518bbd57094e tempest-TestStampPattern-596157518 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-b96ad6d0-207c-4152-a810-5bfd8391c42a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16c5d171-8679-429c-9f05-6161d7e2024b', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (bf20c259-e421-4468-b80f-db994ca4c798) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48b62e7-1775-4af4-8814-3a7d35e78ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-c450e2c0-6b06-4bc6-9cf3-e07202c83ee4 req-80f31a37-dff1-4594-a77f-518bbd57094e tempest-TestStampPattern-596157518 None] attachment_update completed successfully. Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e48b62e7-1775-4af4-8814-3a7d35e78ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202308233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aab844e9-dec7-43e5-a190-5dd495fa2861,host='devstack@QuobyteHD#QuobyteHD',id=c05cb418-5238-4e05-af5e-27fccde1bd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:42Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c5e3a89-22a3-4624-88af-828ae647a546),volume_type_id=1c5e3a89-22a3-4624-88af-828ae647a546)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9fb1b5-2df2-4967-952c-9f68834da108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b9fb1b5-2df2-4967-952c-9f68834da108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f70536-e40b-4592-85d6-d57bbec2db6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (55f70536-e40b-4592-85d6-d57bbec2db6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c05cb418-5238-4e05-af5e-27fccde1bd86', 'volume_name': 'volume-c05cb418-5238-4e05-af5e-27fccde1bd86', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceafdf7c-451a-48c4-8009-a84b1c7c97a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ceafdf7c-451a-48c4-8009-a84b1c7c97a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a710d-a8ee-47d1-9d39-e83ef65fb3f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:42 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Volume c05cb418-5238-4e05-af5e-27fccde1bd86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c05cb418-5238-4e05-af5e-27fccde1bd86', 'volume_size': 1} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aab844e9-dec7-43e5-a190-5dd495fa2861,created_at=2026-09-17T22:46:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-202308233',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aab844e9-dec7-43e5-a190-5dd495fa2861,host='devstack@QuobyteHD#QuobyteHD',id=c05cb418-5238-4e05-af5e-27fccde1bd86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='782ef92999b34ada89a7b4173e87fdb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:46:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:46:42Z,use_quota=True,user_id='368c61de01694fc780f42c9ef061d5dc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1c5e3a89-22a3-4624-88af-828ae647a546),volume_type_id=1c5e3a89-22a3-4624-88af-828ae647a546)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Creating volume c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:46:42 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:46:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:42 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 1073741824 Sep 18 00:46:42 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:43 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 1073741824" returned: 0 in 0.559s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=132,cinder:SELECT=155,cinder:INSERT=30,cinder:DELETE=7 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:43 devstack sudo[102788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 Sep 18 00:46:43 devstack sudo[102788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86" returned: 0 in 0.315s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] <== create_volume: return (938ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:46:43 devstack sudo[102788]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90a710d-a8ee-47d1-9d39-e83ef65fb3f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c05cb418-5238-4e05-af5e-27fccde1bd86', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582d2390-6553-419f-8f9e-ad92655dbe4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:46:43 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Volume volume-c05cb418-5238-4e05-af5e-27fccde1bd86 (c05cb418-5238-4e05-af5e-27fccde1bd86): created successfully Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (582d2390-6553-419f-8f9e-ad92655dbe4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Flow 'volume_create_manager' (bf20c259-e421-4468-b80f-db994ca4c798) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:46:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-03630446-c30c-4b9a-92db-ef7422143f3b tempest-GroupSnapshotsTest-1590475365 None] Created volume successfully. Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-4b0fb0ba-ec06-4d8d-a1f2-2807db357156-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-4b0fb0ba-ec06-4d8d-a1f2-2807db357156-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-quobyte-4b0fb0ba-ec06-4d8d-a1f2-2807db357156" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-4b0fb0ba-ec06-4d8d-a1f2-2807db357156" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Deleting offline snapshot 4b0fb0ba-ec06-4d8d-a1f2-2807db357156 of volume ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] snapshot_file for this snap is: volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d344fee4-a79e-4813-b7ed-47328b3afb1e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:44 devstack sudo[102795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 Sep 18 00:46:44 devstack sudo[102795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:44 devstack sudo[102795]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7bcbab-179a-481f-82e0-bee48c73126b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:44 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[eaf3ad91-c6c3-4e02-8043-ad45409e1221]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:44 devstack sudo[102808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de Sep 18 00:46:44 devstack sudo[102808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:44 devstack sudo[102808]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7bcbab-179a-481f-82e0-bee48c73126b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:44 devstack sudo[102818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 Sep 18 00:46:44 devstack sudo[102818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] GroupSnapshot 441fc14d-b23d-45ec-a2f2-748eb0ae9a01: creating. Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Group snapshot 441fc14d-b23d-45ec-a2f2-748eb0ae9a01: creating. {{(pid=86526) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Creating offline snapshot 8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f of volume c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[218baf95-60f9-4196-925c-2067fd597bf5]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:45 devstack sudo[102823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 Sep 18 00:46:45 devstack sudo[102823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:45 devstack sudo[102818]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156" returned: 0 in 0.491s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:45 devstack sudo[102828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156 Sep 18 00:46:45 devstack sudo[102828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-769a4a3d-fe21-4c37-97b9-5471bde91e5e req-7e5b2cdc-1c83-4b1e-ad1e-ec76ef504b58 tempest-TestStampPattern-596157518 None] Terminate volume connection completed successfully. Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-769a4a3d-fe21-4c37-97b9-5471bde91e5e req-7e5b2cdc-1c83-4b1e-ad1e-ec76ef504b58 tempest-TestStampPattern-596157518 None] Deleting attachment 16c5d171-8679-429c-9f05-6161d7e2024b. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:46:45 devstack sudo[102823]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:45 devstack sudo[102858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f 1G Sep 18 00:46:45 devstack sudo[102858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:45 devstack sudo[102828]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.4b0fb0ba-ec06-4d8d-a1f2-2807db357156" returned: 0 in 0.332s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-4b0fb0ba-ec06-4d8d-a1f2-2807db357156" released by "_delete_snapshot" :: held 1.700s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" released by "delete_snapshot" :: held 1.728s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Created reservations ['89d6105f-15c1-4092-824e-b7ecd2cfbe4f', 'e5564237-c9dc-4b09-a342-05f3d6c3c2a7', 'b37496a5-a103-4194-a74d-b5d9b102239d', 'd6d2f1da-d431-4dfa-82e5-c94dfa209520'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Delete snapshot completed successfully. Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e7203278-d0c0-4aac-a7e8-520629d0c546 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-4b0fb0ba-ec06-4d8d-a1f2-2807db357156-delete_snapshot" released by "delete_snapshot" :: held 1.883s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:45 devstack sudo[102858]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f 1G" returned: 0 in 0.449s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05cb418-5238-4e05-af5e-27fccde1bd86 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:45 devstack sudo[102865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05cb418-5238-4e05-af5e-27fccde1bd86 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f Sep 18 00:46:45 devstack sudo[102865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-05161704-bcae-4071-bf2a-5a7314a376de-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-05161704-bcae-4071-bf2a-5a7314a376de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-quobyte-05161704-bcae-4071-bf2a-5a7314a376de" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-05161704-bcae-4071-bf2a-5a7314a376de" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Deleting offline snapshot 05161704-bcae-4071-bf2a-5a7314a376de of volume ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] snapshot_file for this snap is: volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[44a9b7db-188b-43de-b08f-65da4264fe58]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:46 devstack sudo[102865]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c05cb418-5238-4e05-af5e-27fccde1bd86 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" returned: 0 in 0.353s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:46 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:46 devstack sudo[102869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de Sep 18 00:46:46 devstack sudo[102869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:46 devstack sudo[102871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f Sep 18 00:46:46 devstack sudo[102871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:46 devstack sudo[102871]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" returned: 0 in 0.282s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:46 devstack sudo[102869]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de" returned: 0 in 0.402s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7bcbab-179a-481f-82e0-bee48c73126b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8af9d016-03b1-4cc0-9c70-67a78df9b52b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:46 devstack sudo[102879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.info Sep 18 00:46:46 devstack sudo[102879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:46 devstack sudo[102880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 Sep 18 00:46:46 devstack sudo[102880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:46 devstack sudo[102879]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.info" returned: 0 in 0.321s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:46 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.info is being set with open permissions: ugo+rw: NotImplementedError Sep 18 00:46:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:47 devstack sudo[102886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.info Sep 18 00:46:47 devstack sudo[102886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:47 devstack sudo[102880]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34" returned: 0 in 0.539s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7bcbab-179a-481f-82e0-bee48c73126b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:47 devstack sudo[102891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de Sep 18 00:46:47 devstack sudo[102891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:47 devstack sudo[102886]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.info" returned: 0 in 0.397s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:47 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d6044e2a-4b2f-436e-b1a0-5432bf2a5429 tempest-GroupSnapshotsTest-1590475365 None] group_snapshot 441fc14d-b23d-45ec-a2f2-748eb0ae9a01: created successfully Sep 18 00:46:47 devstack sudo[102891]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de" returned: 0 in 0.667s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:47 devstack sudo[102918]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de Sep 18 00:46:47 devstack sudo[102918]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:48 devstack sudo[102918]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.05161704-bcae-4071-bf2a-5a7314a376de" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-05161704-bcae-4071-bf2a-5a7314a376de" released by "_delete_snapshot" :: held 2.053s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" released by "delete_snapshot" :: held 2.087s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Created reservations ['d81784a2-132f-4569-be79-d1fd524f927c', '631da03d-6feb-477f-9707-5804c7077ac2', '8d7afa74-418c-42a9-92e3-db3d337891bc', '9e9a6c80-59d8-49be-8597-7f61444ff0a6'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Delete snapshot completed successfully. Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f7373ee9-9a2a-4089-a7c3-1ed491765c18 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-05161704-bcae-4071-bf2a-5a7314a376de-delete_snapshot" released by "delete_snapshot" :: held 2.273s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] group_snapshot 441fc14d-b23d-45ec-a2f2-748eb0ae9a01: deleting Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] group_snapshot 441fc14d-b23d-45ec-a2f2-748eb0ae9a01: deleting {{(pid=86526) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-c05cb418-5238-4e05-af5e-27fccde1bd86" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-c05cb418-5238-4e05-af5e-27fccde1bd86" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Deleting offline snapshot 8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f of volume c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] snapshot_file for this snap is: volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c398d23c-602d-45d2-912f-e6391a7d7ac1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:48 devstack sudo[102923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f Sep 18 00:46:48 devstack sudo[102923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:49 devstack sudo[102923]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" returned: 0 in 0.458s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c05cb418-5238-4e05-af5e-27fccde1bd86(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[30200d55-3802-4ee4-98e9-51d1aea083cd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:49 devstack sudo[102930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 Sep 18 00:46:49 devstack sudo[102930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-1d5fe8d5-d2ee-4977-a922-1f51996adb34-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-1d5fe8d5-d2ee-4977-a922-1f51996adb34-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-quobyte-1d5fe8d5-d2ee-4977-a922-1f51996adb34" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-1d5fe8d5-d2ee-4977-a922-1f51996adb34" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Deleting offline snapshot 1d5fe8d5-d2ee-4977-a922-1f51996adb34 of volume ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] snapshot_file for this snap is: volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffa6717b-fec5-4354-8edd-fc2b7ad4f3a8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:49 devstack sudo[102930]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86" returned: 0 in 0.408s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:49 devstack sudo[102936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f Sep 18 00:46:49 devstack sudo[102936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:49 devstack sudo[102935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 Sep 18 00:46:49 devstack sudo[102935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:49 devstack sudo[102936]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:49 devstack sudo[102935]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" returned: 0 in 0.343s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34" returned: 0 in 0.377s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ff7bcbab-179a-481f-82e0-bee48c73126b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:49 devstack sudo[102945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f Sep 18 00:46:49 devstack sudo[102945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[64bea563-e844-4db7-b161-3ec18de07542]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-b96ad6d0-207c-4152-a810-5bfd8391c42a-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Lock "cinder-b96ad6d0-207c-4152-a810-5bfd8391c42a-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:50 devstack sudo[102947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b Sep 18 00:46:50 devstack sudo[102947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-quobyte-b96ad6d0-207c-4152-a810-5bfd8391c42a" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-b96ad6d0-207c-4152-a810-5bfd8391c42a" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c02e8604-d872-4b71-9f42-8865713b468a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:50 devstack sudo[102945]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86.8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" returned: 0 in 0.288s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-8130a7e6-4f87-4912-9b51-b5fc1f2fcb5f" released by "_delete_snapshot" :: held 1.627s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-c05cb418-5238-4e05-af5e-27fccde1bd86" released by "delete_snapshot" :: held 1.652s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:50 devstack sudo[102950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a Sep 18 00:46:50 devstack sudo[102950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:50 devstack cinder-volume[86526]: WARNING cinder.quota [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-871652311 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-871652311, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:50 devstack cinder-volume[86526]: WARNING cinder.quota [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-871652311 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-871652311, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['232a33ca-8418-4ac2-8ed6-98a7620604fb', 'cd29d721-55d8-41c7-9301-fbb07c9da89e', '7ac01978-e8b7-4ea1-8c5d-febcb683c3be', 'a29c59b2-17ea-42d1-8175-31aaa3cdffa5'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:50 devstack sudo[102947]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b" returned: 0 in 0.438s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8cb715d0-0a7a-458f-a6fc-21835b697c0d tempest-GroupSnapshotsTest-1590475365 None] group_snapshot 441fc14d-b23d-45ec-a2f2-748eb0ae9a01: deleted successfully Sep 18 00:46:50 devstack sudo[102955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 Sep 18 00:46:50 devstack sudo[102955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:50 devstack sudo[102950]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a" returned: 0 in 0.403s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:50 devstack sudo[102960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a Sep 18 00:46:50 devstack sudo[102960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:50 devstack sudo[102955]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34" returned: 0 in 0.342s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:50 devstack sudo[102965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34 Sep 18 00:46:50 devstack sudo[102965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:50 devstack sudo[102960]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b96ad6d0-207c-4152-a810-5bfd8391c42a" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-b96ad6d0-207c-4152-a810-5bfd8391c42a" released by "delete_volume" :: held 0.741s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Created reservations ['6a417b2f-4c67-400c-b827-feb31e21af62', '365d514b-0c71-44ac-9fa4-d72030a7abf4', '31e7e609-6057-4f5a-81f3-d84adb3fdcc0', 'dcc9b3f8-6c28-4f9d-b02d-2d4a2eee433e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:50 devstack sudo[102970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:50 devstack sudo[102970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:50 devstack sudo[102965]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b.1d5fe8d5-d2ee-4977-a922-1f51996adb34" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-1d5fe8d5-d2ee-4977-a922-1f51996adb34" released by "_delete_snapshot" :: held 1.599s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" released by "delete_snapshot" :: held 1.627s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Created reservations ['5b701d6a-4cbb-47af-8b21-fec5d47e2f34', '5cb881c2-30aa-49aa-b11d-5c345fd68a9b', 'fda079b5-eacd-48f2-a4cb-c6a35583d664', 'd8715967-891f-4d40-8a71-4fbc28e3e22b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "cinder-quobyte-c05cb418-5238-4e05-af5e-27fccde1bd86" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-c05cb418-5238-4e05-af5e-27fccde1bd86" acquired by "delete_volume" :: waited 0.044s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:51 devstack sudo[102970]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Deleted volume successfully. Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c72e4a93-2b60-42f7-90ba-272b95880759]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4740cd3-fb90-4024-903e-be77c9a9e548 tempest-TestStampPattern-596157518 None] Lock "cinder-b96ad6d0-207c-4152-a810-5bfd8391c42a-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Delete snapshot completed successfully. Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-315c5451-4614-40c6-94ff-79b66ebb3ae4 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-1d5fe8d5-d2ee-4977-a922-1f51996adb34-delete_snapshot" released by "delete_snapshot" :: held 1.987s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:51 devstack sudo[102973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 Sep 18 00:46:51 devstack sudo[102973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-098bf870-6cfe-4ae2-a748-dde50c3ab9c4-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Lock "cinder-098bf870-6cfe-4ae2-a748-dde50c3ab9c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-quobyte-e41b811d-8ce5-405b-b47a-a973513172f9" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-e41b811d-8ce5-405b-b47a-a973513172f9" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-quobyte-098bf870-6cfe-4ae2-a748-dde50c3ab9c4" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-098bf870-6cfe-4ae2-a748-dde50c3ab9c4" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Deleting offline snapshot 098bf870-6cfe-4ae2-a748-dde50c3ab9c4 of volume e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] snapshot_file for this snap is: volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-ff7bcbab-179a-481f-82e0-bee48c73126b-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b69a458-e85e-4eee-b0f7-8a83bf07187c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-ff7bcbab-179a-481f-82e0-bee48c73126b-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:51 devstack sudo[102973]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86" returned: 0 in 0.451s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:51 devstack sudo[102979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86 Sep 18 00:46:51 devstack sudo[102979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:51 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 Sep 18 00:46:51 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[17732e2d-44c6-4495-9cc8-5dd09d20374d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:51 devstack sudo[102982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b Sep 18 00:46:51 devstack sudo[102982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:52 devstack sudo[102979]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c05cb418-5238-4e05-af5e-27fccde1bd86" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Lock "cinder-quobyte-c05cb418-5238-4e05-af5e-27fccde1bd86" released by "delete_volume" :: held 0.856s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:52 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4" returned: 0 in 0.428s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e41b811d-8ce5-405b-b47a-a973513172f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb5e136c-c84d-4a76-ae34-24749629a2d0]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['08b4bcd3-da67-4b04-b0e1-2acb11f43558'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:52 devstack cinder-volume[86526]: WARNING cinder.quota [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-871652311 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-871652311, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:46:52 devstack sudo[102982]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b" returned: 0 in 0.409s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Created reservations ['8807a6e0-2f00-4a17-a5a7-4db65eb4ca18', '897cf34f-c18e-4dc3-90b0-d51d00ad116d', '64c93d04-4778-4b57-bc09-6d919e7140fe', '44a7118a-7e26-4b09-87a8-53ab268c93a0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:52 devstack sudo[102992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b Sep 18 00:46:52 devstack sudo[102992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:52 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 Sep 18 00:46:52 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:52 devstack sudo[102995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:52 devstack sudo[102995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:52 devstack sudo[102992]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ff7bcbab-179a-481f-82e0-bee48c73126b" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-quobyte-ff7bcbab-179a-481f-82e0-bee48c73126b" released by "delete_volume" :: held 0.754s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Created reservations ['91eee33c-c8d2-48bb-a39b-deefc72c655a', '20bd7049-133f-43ac-a862-e1677e77e560', '82b511c9-d72a-4321-a362-de216761d729', 'bb4c669e-80aa-4279-8702-4f55ed363ef1'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:52 devstack sudo[103000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:46:52 devstack sudo[103000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:52 devstack sudo[102995]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:52 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-dbbc2592-434e-42ec-ab35-7c3193a0374e tempest-GroupSnapshotsTest-1590475365 None] Delete group completed successfully. Sep 18 00:46:52 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9" returned: 0 in 0.627s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:52 devstack sudo[103004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 Sep 18 00:46:52 devstack sudo[103004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:52 devstack sudo[103000]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:46:52 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Deleted volume successfully. Sep 18 00:46:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1bcd50a3-a4f2-4728-bb45-d2bb3c2c19e1 tempest-VolumesSnapshotListTestJSON-279304238 None] Lock "cinder-ff7bcbab-179a-481f-82e0-bee48c73126b-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:53 devstack sudo[103004]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4" returned: 0 in 0.398s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:46:53 devstack sudo[103010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4 Sep 18 00:46:53 devstack sudo[103010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:46:53 devstack sudo[103010]: pam_unix(sudo:session): session closed for user root Sep 18 00:46:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9.098bf870-6cfe-4ae2-a748-dde50c3ab9c4" returned: 0 in 0.291s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:46:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-098bf870-6cfe-4ae2-a748-dde50c3ab9c4" released by "_delete_snapshot" :: held 1.919s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-e41b811d-8ce5-405b-b47a-a973513172f9" released by "delete_snapshot" :: held 1.947s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:53 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Created reservations ['4d1201a0-74dd-46ef-9217-c87c57860e35', '0efda5b0-9f4d-4ecb-99ab-60a49643b9a1', 'ab3c8dc7-84fb-47d7-8a7f-95d9ebea86bf', 'f36a90d8-3b4d-41db-9975-6c9abebace32'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:46:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Delete snapshot completed successfully. Sep 18 00:46:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ffce5f61-371a-4897-b537-e122d178d2f5 tempest-TestStampPattern-596157518 None] Lock "cinder-098bf870-6cfe-4ae2-a748-dde50c3ab9c4-delete_snapshot" released by "delete_snapshot" :: held 2.189s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:46:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-e41b811d-8ce5-405b-b47a-a973513172f9-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Lock "cinder-e41b811d-8ce5-405b-b47a-a973513172f9-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Acquiring lock "cinder-quobyte-e41b811d-8ce5-405b-b47a-a973513172f9" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:46:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-e41b811d-8ce5-405b-b47a-a973513172f9" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:46:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c2fdba-d82e-4115-b153-c2183f48902c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:46:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:00 devstack sudo[103048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 Sep 18 00:47:00 devstack sudo[103048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:00 devstack sudo[103048]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9" returned: 0 in 0.410s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:00 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9 Sep 18 00:47:00 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:00 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e41b811d-8ce5-405b-b47a-a973513172f9" returned: 0 in 0.300s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Lock "cinder-quobyte-e41b811d-8ce5-405b-b47a-a973513172f9" released by "delete_volume" :: held 0.784s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Created reservations ['dd3258d7-4cd5-4d2a-992b-5ffffd5166a0', '56f4ee37-70ca-440a-b553-c361d3ced56f', '1d19e01e-d884-4ff6-898a-cedf2ca90c82', '55eb9d71-5aea-447a-bed3-9b5ff74f4c68'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:00 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:00 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:01 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.289s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:01 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:01 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Deleted volume successfully. Sep 18 00:47:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-261a1755-a90a-4fb0-8abc-e9442eae3473 tempest-TestStampPattern-596157518 None] Lock "cinder-e41b811d-8ce5-405b-b47a-a973513172f9-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:04 devstack sudo[103061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:04 devstack sudo[103061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:04 devstack sudo[103061]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:47:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:47:10 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=61,cinder:SELECT=60,cinder:INSERT=18 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:47:11 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=170,cinder:INSERT=59,cinder:UPDATE=197,cinder:DELETE=9 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:47:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0e1b87f1-096d-4a3b-84b5-d49dc296814a tempest-GroupsTest-84461201 None] Group tempest-Group1-1251654357: creating Sep 18 00:47:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0e1b87f1-096d-4a3b-84b5-d49dc296814a tempest-GroupsTest-84461201 None] Group tempest-Group1-1251654357: created successfully Sep 18 00:47:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0e1b87f1-096d-4a3b-84b5-d49dc296814a tempest-GroupsTest-84461201 None] Create group completed successfully. Sep 18 00:47:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-aee6422c-4ccb-4e38-a612-552dc0262592 tempest-GroupsTest-84461201 None] Group tempest-Group2-597627831: creating Sep 18 00:47:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-aee6422c-4ccb-4e38-a612-552dc0262592 tempest-GroupsTest-84461201 None] Group tempest-Group2-597627831: created successfully Sep 18 00:47:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-aee6422c-4ccb-4e38-a612-552dc0262592 tempest-GroupsTest-84461201 None] Create group completed successfully. Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Flow 'volume_create_manager' (0b72d144-3c1c-442a-b29a-8514c390bbfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4653d8e-0a50-49ff-bccb-9ee5ed230921) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4653d8e-0a50-49ff-bccb-9ee5ed230921) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-439830803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=119b3fd6-a231-4a04-984f-dce5c5228564,host='devstack@QuobyteHD#QuobyteHD',id=fecf3e07-f08a-4dbe-b8fb-9a775eaf1458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2368d88daf4a4a96b200f0fb6a9c95b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:15Z,use_quota=True,user_id='54e30b9892c64a1f8a0c067505bd4f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b714663-a823-4848-b903-f47f9d81eed6),volume_type_id=2b714663-a823-4848-b903-f47f9d81eed6)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeff393-a7be-42b1-bc0f-a3edb24c766b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3eeff393-a7be-42b1-bc0f-a3edb24c766b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954477b2-c412-4f1d-8767-7ff9cc3e5fb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (954477b2-c412-4f1d-8767-7ff9cc3e5fb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fecf3e07-f08a-4dbe-b8fb-9a775eaf1458', 'volume_name': 'volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed1cb91-bc0c-40d9-a910-fd5c03faabb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ed1cb91-bc0c-40d9-a910-fd5c03faabb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9fe9ca-d596-4feb-9c4d-c1f8f87d0187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Volume fecf3e07-f08a-4dbe-b8fb-9a775eaf1458: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458', 'volume_size': 1} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=119b3fd6-a231-4a04-984f-dce5c5228564,created_at=2026-09-17T22:47:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-439830803',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=119b3fd6-a231-4a04-984f-dce5c5228564,host='devstack@QuobyteHD#QuobyteHD',id=fecf3e07-f08a-4dbe-b8fb-9a775eaf1458,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2368d88daf4a4a96b200f0fb6a9c95b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:15Z,use_quota=True,user_id='54e30b9892c64a1f8a0c067505bd4f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(2b714663-a823-4848-b903-f47f9d81eed6),volume_type_id=2b714663-a823-4848-b903-f47f9d81eed6)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Creating volume fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:15 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:47:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:15 devstack sudo[103110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 1073741824 Sep 18 00:47:15 devstack sudo[103110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:16 devstack sudo[103110]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 1073741824" returned: 0 in 0.510s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:16 devstack sudo[103115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 Sep 18 00:47:16 devstack sudo[103115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:16 devstack sudo[103115]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7b9fe9ca-d596-4feb-9c4d-c1f8f87d0187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d6513d-30aa-42d0-8179-dc195c7df429) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Volume volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 (fecf3e07-f08a-4dbe-b8fb-9a775eaf1458): created successfully Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61d6513d-30aa-42d0-8179-dc195c7df429) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Flow 'volume_create_manager' (0b72d144-3c1c-442a-b29a-8514c390bbfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d5dab563-5922-4495-9fb4-7d9e38d0bce1 tempest-GroupsTest-84461201 None] Created volume successfully. Sep 18 00:47:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Acquiring lock "cinder-quobyte-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Lock "cinder-quobyte-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:17 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c26da3f9-0e33-4656-b6b9-39118560970d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:17 devstack sudo[103119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 Sep 18 00:47:17 devstack sudo[103119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:17 devstack sudo[103119]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458" returned: 0 in 0.472s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:17 devstack sudo[103124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458 Sep 18 00:47:17 devstack sudo[103124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:18 devstack sudo[103124]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458" returned: 0 in 0.300s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Lock "cinder-quobyte-fecf3e07-f08a-4dbe-b8fb-9a775eaf1458" released by "delete_volume" :: held 0.855s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Created reservations ['67c0330d-fe77-483b-8877-6ba9ca2aaf4c'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:18 devstack cinder-volume[86526]: WARNING cinder.quota [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1447670495 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1447670495, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:47:18 devstack cinder-volume[86526]: WARNING cinder.quota [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1447670495 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1447670495, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Created reservations ['1dc53f8c-e8f9-4f4f-be7d-e76a6d8c5de1', 'ba127766-adeb-4088-b983-3f307a2caf1a', '8ee7cd17-a6c1-4ca4-97d4-95de487b02e4', '763dc6e4-6e05-43ec-92e6-798fda679906'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:18 devstack sudo[103127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:18 devstack sudo[103127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:18 devstack sudo[103127]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Created reservations ['4cf364af-b718-46ac-8f2a-2d8011733ec3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8e3c8adb-cc3f-4546-af20-29ee3e7adb24 tempest-GroupsTest-84461201 None] Delete group completed successfully. Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:18 devstack sudo[103130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:18 devstack sudo[103130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:19 devstack sudo[103130]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.274s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:19 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4e7f4ece-e8b7-450e-8272-39d40f691461 tempest-GroupsTest-84461201 None] Delete group completed successfully. Sep 18 00:47:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-15cfe56c-a144-4db2-a2ee-253cf38904c7 tempest-GroupsTest-84461201 None] Group tempest-GroupsTest-Group-1878031596: creating Sep 18 00:47:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-15cfe56c-a144-4db2-a2ee-253cf38904c7 tempest-GroupsTest-84461201 None] Group tempest-GroupsTest-Group-1878031596: created successfully Sep 18 00:47:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-15cfe56c-a144-4db2-a2ee-253cf38904c7 tempest-GroupsTest-84461201 None] Create group completed successfully. Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Flow 'volume_create_manager' (2c00267d-dc8c-4be4-b5ce-b7cc77b88aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ec252b-440a-420d-8887-9b13958e5c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9ec252b-440a-420d-8887-9b13958e5c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-799453705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab53017-24ff-4f1c-9cc3-61514944bb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9cb600a72485ab9badaa91e2c2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:21Z,use_quota=True,user_id='111fb8ef87ee4fafb73f62e80b4717bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde4a31c-576c-4774-9654-b623a307771e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fde4a31c-576c-4774-9654-b623a307771e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1abfa7-6e2a-47d9-9404-5e16a4440f8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf1abfa7-6e2a-47d9-9404-5e16a4440f8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0ab53017-24ff-4f1c-9cc3-61514944bb5d', 'volume_name': 'volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d4bc4f-c77c-467b-9af2-34cf06dc6202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f3d4bc4f-c77c-467b-9af2-34cf06dc6202) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032ed68a-605d-417d-bc65-933cda45df4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Volume 0ab53017-24ff-4f1c-9cc3-61514944bb5d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d', 'volume_size': 1} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-799453705',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0ab53017-24ff-4f1c-9cc3-61514944bb5d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9cb600a72485ab9badaa91e2c2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:21Z,use_quota=True,user_id='111fb8ef87ee4fafb73f62e80b4717bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Creating volume 0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:20 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:47:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:20 devstack sudo[103133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d 1073741824 Sep 18 00:47:20 devstack sudo[103133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:21 devstack sudo[103133]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d 1073741824" returned: 0 in 0.459s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:21 devstack sudo[103140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d Sep 18 00:47:21 devstack sudo[103140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:21 devstack sudo[103140]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d" returned: 0 in 0.271s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (032ed68a-605d-417d-bc65-933cda45df4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a53ee5f-6f6d-4f02-83f2-1f3d18afd825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Volume volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d (0ab53017-24ff-4f1c-9cc3-61514944bb5d): created successfully Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a53ee5f-6f6d-4f02-83f2-1f3d18afd825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Flow 'volume_create_manager' (2c00267d-dc8c-4be4-b5ce-b7cc77b88aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0deb9a90-46cf-4ed8-9aad-231a214d2f20 tempest-VolumeDependencyTests-1379971897 None] Created volume successfully. Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Creating offline snapshot 8a3ea952-6a5f-4def-bca1-f42fe938452c of volume 0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[17e6b266-eae3-4b18-91e7-7931ce0327ef]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:22 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d Sep 18 00:47:22 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Flow 'volume_create_manager' (b6000d0c-c795-4a03-9de7-e44d7e6c2645) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65732fb-9f83-49ba-832b-907f023d4bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c65732fb-9f83-49ba-832b-907f023d4bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448510047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33fcbcec-9bb2-4abc-81b1-b91032ebf05e,host='devstack@QuobyteHD#QuobyteHD',id=a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2368d88daf4a4a96b200f0fb6a9c95b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:22Z,use_quota=True,user_id='54e30b9892c64a1f8a0c067505bd4f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d748b7c6-2289-4783-ab19-0e5a301b6593),volume_type_id=d748b7c6-2289-4783-ab19-0e5a301b6593)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fee42cd-d4b5-4ccc-916f-a7a8301435cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2fee42cd-d4b5-4ccc-916f-a7a8301435cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea554f8-8f4e-4773-8786-53da4c4ed5e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bea554f8-8f4e-4773-8786-53da4c4ed5e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa', 'volume_name': 'volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4bda0f-5faa-4b4e-9cf5-d3c4b27eaa8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5e4bda0f-5faa-4b4e-9cf5-d3c4b27eaa8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd716d0e-e515-4482-8d79-408116c9d07f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Volume a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa', 'volume_size': 1} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:22 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d" returned: 0 in 0.449s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:22 devstack sudo[103148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c 1G Sep 18 00:47:22 devstack sudo[103148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Flow 'volume_create_manager' (ecd1fd7a-b692-4cfe-8aa9-39ff2d1c2960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8497e41c-0ab5-44fc-87d5-c1b899ca9d57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8497e41c-0ab5-44fc-87d5-c1b899ca9d57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1524983277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8865cc8-352e-409c-bbf6-ba23baa7f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78ab64812624b19aa6e1f529497d887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:23Z,use_quota=True,user_id='ca639e3b51ea4083926a1e13728a80db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(854a882c-b24c-4041-a892-c7952b7e19a3),volume_type_id=854a882c-b24c-4041-a892-c7952b7e19a3)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e507482d-b42a-449d-890c-7aae25f4532e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e507482d-b42a-449d-890c-7aae25f4532e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb50ca87-86c5-4b8f-9fce-0b5787be4548) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (eb50ca87-86c5-4b8f-9fce-0b5787be4548) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8865cc8-352e-409c-bbf6-ba23baa7f7c1', 'volume_name': 'volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb3f9d9-ca84-4b29-b3b5-48778556af36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deb3f9d9-ca84-4b29-b3b5-48778556af36) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a8396b-b642-4fb3-bbbb-da2972e1d6f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume b8865cc8-352e-409c-bbf6-ba23baa7f7c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1', 'volume_size': 1} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:22 devstack sudo[103148]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c 1G" returned: 0 in 0.492s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:22 devstack sudo[103154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c Sep 18 00:47:22 devstack sudo[103154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:23 devstack sudo[103154]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Flow 'volume_create_manager' (9810db9e-458d-42d2-9eb9-3601876c0d9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df542208-6d3c-4091-82b6-83f59230d630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c" returned: 0 in 0.348s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:23 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c is being set with open permissions: ugo+rw Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df542208-6d3c-4091-82b6-83f59230d630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1781929981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837b4526-ddbf-4167-bc1f-5c8a50bb9e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78ab64812624b19aa6e1f529497d887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:23Z,use_quota=True,user_id='ca639e3b51ea4083926a1e13728a80db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(868e7459-25a3-4eab-8055-c796458c32b5),volume_type_id=868e7459-25a3-4eab-8055-c796458c32b5)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f125388-8b1c-4709-a455-0a3125ae2b83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f125388-8b1c-4709-a455-0a3125ae2b83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:23 devstack sudo[103159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c Sep 18 00:47:23 devstack sudo[103159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87bd3ca-da4f-460c-a1e2-6c87e8089950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b87bd3ca-da4f-460c-a1e2-6c87e8089950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '837b4526-ddbf-4167-bc1f-5c8a50bb9e09', 'volume_name': 'volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3139fd68-4c3d-4ef7-9d22-b9dccb9bbf45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3139fd68-4c3d-4ef7-9d22-b9dccb9bbf45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e27bcf5-3a0c-481a-ae7e-275aa193dd0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume 837b4526-ddbf-4167-bc1f-5c8a50bb9e09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09', 'volume_size': 1} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:23 devstack sudo[103159]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c" returned: 0 in 0.312s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:23 devstack sudo[103162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.info Sep 18 00:47:23 devstack sudo[103162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Flow 'volume_create_manager' (a2519239-57d7-4226-b8d0-3884e2e504cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e1c2bc-fb4e-47ad-83d1-4d026443348d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29e1c2bc-fb4e-47ad-83d1-4d026443348d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-116288210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef02fd22-03de-4bb2-a64f-92a69febf4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78ab64812624b19aa6e1f529497d887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:24Z,use_quota=True,user_id='ca639e3b51ea4083926a1e13728a80db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8fb1789-e222-43a2-91a3-090552c40ec2),volume_type_id=e8fb1789-e222-43a2-91a3-090552c40ec2)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae9c13e-b60d-4cf8-9e8b-c2ae1fcf0be9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cae9c13e-b60d-4cf8-9e8b-c2ae1fcf0be9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab517ed-e1c0-4658-a34c-920079864acf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:47:23 devstack sudo[103162]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.info" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:23 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.info is being set with open permissions: ugo+rw Sep 18 00:47:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:23 devstack sudo[103165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.info Sep 18 00:47:23 devstack sudo[103165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0ab517ed-e1c0-4658-a34c-920079864acf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'ef02fd22-03de-4bb2-a64f-92a69febf4d8', 'volume_name': 'volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8', 'volume_size': 1, 'image_id': '0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2106466041', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a78ab64812624b19aa6e1f529497d887', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'created_at': datetime.datetime(2026, 9, 17, 22, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 47, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442/file', 'properties': {}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524da452-807d-4c0f-a209-f97edba91ab5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (524da452-807d-4c0f-a209-f97edba91ab5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2aea65-7c06-4180-8e84-630120f3b73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:24 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume ef02fd22-03de-4bb2-a64f-92a69febf4d8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8', 'volume_size': 1, 'image_id': '0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2106466041', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a78ab64812624b19aa6e1f529497d887', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'created_at': datetime.datetime(2026, 9, 17, 22, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 47, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442/file', 'properties': {}}, 'image_service': } Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Trying to clone ef02fd22-03de-4bb2-a64f-92a69febf4d8 from image 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 at location (None, [{'url': 'file:///opt/stack/data/glance/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:47:24 devstack sudo[103165]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.info" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.231s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.895s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33fcbcec-9bb2-4abc-81b1-b91032ebf05e,created_at=2026-09-17T22:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1448510047',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33fcbcec-9bb2-4abc-81b1-b91032ebf05e,host='devstack@QuobyteHD#QuobyteHD',id=a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2368d88daf4a4a96b200f0fb6a9c95b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:22Z,use_quota=True,user_id='54e30b9892c64a1f8a0c067505bd4f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d748b7c6-2289-4783-ab19-0e5a301b6593),volume_type_id=d748b7c6-2289-4783-ab19-0e5a301b6593)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Creating volume a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:24 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:24 devstack sudo[103168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa 1073741824 Sep 18 00:47:24 devstack sudo[103168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-600025d9-87a0-4ebd-88b8-10b9e7e70059 tempest-VolumeDependencyTests-1379971897 None] Create snapshot completed successfully Sep 18 00:47:24 devstack sudo[103168]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa 1073741824" returned: 0 in 0.496s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:24 devstack sudo[103174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa Sep 18 00:47:24 devstack sudo[103174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:24 devstack sudo[103174]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.170s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1524983277',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8865cc8-352e-409c-bbf6-ba23baa7f7c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78ab64812624b19aa6e1f529497d887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:23Z,use_quota=True,user_id='ca639e3b51ea4083926a1e13728a80db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(854a882c-b24c-4041-a892-c7952b7e19a3),volume_type_id=854a882c-b24c-4041-a892-c7952b7e19a3)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Creating volume b8865cc8-352e-409c-bbf6-ba23baa7f7c1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:25 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd716d0e-e515-4482-8d79-408116c9d07f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack sudo[103177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 1073741824 Sep 18 00:47:25 devstack sudo[103177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8bd5e0-3509-4ae1-8168-f35e29395e19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Volume volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa (a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa): created successfully Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a8bd5e0-3509-4ae1-8168-f35e29395e19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Flow 'volume_create_manager' (b6000d0c-c795-4a03-9de7-e44d7e6c2645) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-de8c4ebd-fd28-42bc-b425-bad073c1421c tempest-GroupsTest-84461201 None] Created volume successfully. Sep 18 00:47:25 devstack sudo[103177]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 1073741824" returned: 0 in 0.516s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:25 devstack sudo[103183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 Sep 18 00:47:25 devstack sudo[103183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Flow 'volume_create_manager' (c7ee64c7-5c9f-4a24-af01-26c85ec88fb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:25 devstack sudo[103183]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d5387b-db8e-4dd8-a44b-5ff3015c3ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1" returned: 0 in 0.285s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] <== create_volume: return (845ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.471s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1781929981',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=837b4526-ddbf-4167-bc1f-5c8a50bb9e09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78ab64812624b19aa6e1f529497d887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:23Z,use_quota=True,user_id='ca639e3b51ea4083926a1e13728a80db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(868e7459-25a3-4eab-8055-c796458c32b5),volume_type_id=868e7459-25a3-4eab-8055-c796458c32b5)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Creating volume 837b4526-ddbf-4167-bc1f-5c8a50bb9e09 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:25 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05d5387b-db8e-4dd8-a44b-5ff3015c3ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1871363430',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=718eb2c5-fde4-4625-8537-57a5dbb8985b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4aa9cb600a72485ab9badaa91e2c2b3d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=8a3ea952-6a5f-4def-bca1-f42fe938452c,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:26Z,use_quota=True,user_id='111fb8ef87ee4fafb73f62e80b4717bd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9951c899-e02d-4e8a-8de4-b9e09af8b880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:25 devstack sudo[103186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 1073741824 Sep 18 00:47:25 devstack sudo[103186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9951c899-e02d-4e8a-8de4-b9e09af8b880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d71929-9820-475a-99ce-995b54c6cb2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (78d71929-9820-475a-99ce-995b54c6cb2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '718eb2c5-fde4-4625-8537-57a5dbb8985b', 'volume_name': 'volume-718eb2c5-fde4-4625-8537-57a5dbb8985b', 'volume_size': 1, 'snapshot_id': '8a3ea952-6a5f-4def-bca1-f42fe938452c'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f08a41-2d77-458c-bfff-750984e93dba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65f08a41-2d77-458c-bfff-750984e93dba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c66a83-db91-4449-9740-6ec6b4c65f33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Volume 718eb2c5-fde4-4625-8537-57a5dbb8985b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-718eb2c5-fde4-4625-8537-57a5dbb8985b', 'volume_size': 1, 'snapshot_id': '8a3ea952-6a5f-4def-bca1-f42fe938452c'} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (02a8396b-b642-4fb3-bbbb-da2972e1d6f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab4d57b-a6f6-4b6d-840f-d04619f12fa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 (b8865cc8-352e-409c-bbf6-ba23baa7f7c1): created successfully Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dab4d57b-a6f6-4b6d-840f-d04619f12fa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Flow 'volume_create_manager' (ecd1fd7a-b692-4cfe-8aa9-39ff2d1c2960) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f46039ec-c900-4007-ae80-7d3e756e9b63 tempest-TestInstancesWithCinderVolumes-93885566 None] Created volume successfully. Sep 18 00:47:26 devstack sudo[103186]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 1073741824" returned: 0 in 0.572s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Flow 'volume_create_manager' (6be80c99-fbd0-4558-a715-e022eb8860fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dd4b1b-75bf-4f37-afec-c1657de23b30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a4dd4b1b-75bf-4f37-afec-c1657de23b30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381422949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33fcbcec-9bb2-4abc-81b1-b91032ebf05e,host='devstack@QuobyteHD#QuobyteHD',id=5edd9f94-50be-4ac2-b9fa-598e5685776a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2368d88daf4a4a96b200f0fb6a9c95b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:26Z,use_quota=True,user_id='54e30b9892c64a1f8a0c067505bd4f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d748b7c6-2289-4783-ab19-0e5a301b6593),volume_type_id=d748b7c6-2289-4783-ab19-0e5a301b6593)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254fa451-6b37-4238-8779-af9b986dd841) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (254fa451-6b37-4238-8779-af9b986dd841) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d019daa-5241-49bb-9833-ed65bcd5cd27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d019daa-5241-49bb-9833-ed65bcd5cd27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5edd9f94-50be-4ac2-b9fa-598e5685776a', 'volume_name': 'volume-5edd9f94-50be-4ac2-b9fa-598e5685776a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6903a637-6e74-4a5c-b803-1e8d3352a6f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6903a637-6e74-4a5c-b803-1e8d3352a6f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d5fb92-01ba-43f4-969c-1613240ce737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:26 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Volume 5edd9f94-50be-4ac2-b9fa-598e5685776a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5edd9f94-50be-4ac2-b9fa-598e5685776a', 'volume_size': 1} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:26 devstack sudo[103192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 Sep 18 00:47:26 devstack sudo[103192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:26 devstack sudo[103192]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.970s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.868s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-quobyte-8a3ea952-6a5f-4def-bca1-f42fe938452c-718eb2c5-fde4-4625-8537-57a5dbb8985b" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e27bcf5-3a0c-481a-ae7e-275aa193dd0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf7e971-a68d-4c5b-81ca-0579e224fbf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-8a3ea952-6a5f-4def-bca1-f42fe938452c-718eb2c5-fde4-4625-8537-57a5dbb8985b" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Creating volume 718eb2c5-fde4-4625-8537-57a5dbb8985b from snapshot 8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-quobyte-718eb2c5-fde4-4625-8537-57a5dbb8985b" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:26 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 (837b4526-ddbf-4167-bc1f-5c8a50bb9e09): created successfully Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf7e971-a68d-4c5b-81ca-0579e224fbf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Flow 'volume_create_manager' (9810db9e-458d-42d2-9eb9-3601876c0d9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-718eb2c5-fde4-4625-8537-57a5dbb8985b" acquired by "_copy_volume_from_snapshot" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] snapshot: 8a3ea952-6a5f-4def-bca1-f42fe938452c, volume: 718eb2c5-fde4-4625-8537-57a5dbb8985b, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:47:26 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7242d52a-757a-4960-9efd-5ce627f19d33 tempest-TestInstancesWithCinderVolumes-93885566 None] Created volume successfully. Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d9adf8-a43e-4207-b85c-db6401e22bd7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:27 devstack sudo[103195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c Sep 18 00:47:27 devstack sudo[103195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:27 devstack sudo[103195]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c" returned: 0 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f3bd3ff-6f46-432f-b8fd-a3ccdd0b43d3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:27 devstack sudo[103200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d Sep 18 00:47:27 devstack sudo[103200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:27 devstack sudo[103200]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:47:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:27 devstack sudo[103205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b Sep 18 00:47:27 devstack sudo[103205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:28 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD, size 20.69 MB, duration 3.99 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:47:28 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Image download 20.69 MB at 5.18 MB/s Sep 18 00:47:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[af7130e4-a186-4a7a-8fb0-f82fd5a8bfb6]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:28 devstack sudo[103217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD Sep 18 00:47:28 devstack sudo[103217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:28 devstack sudo[103217]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:28 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Temporary image 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 is fetched for user ca639e3b51ea4083926a1e13728a80db. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:47:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[eec5f801-32f9-4c09-a0b2-31656391b638]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:29 devstack sudo[103222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD Sep 18 00:47:29 devstack sudo[103222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:29 devstack sudo[103222]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD" returned: 0 in 0.606s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:34 devstack sudo[103205]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b" returned: 0 in 6.435s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d, size 1024.00 MB, duration 6.44 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:47:34 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Converted 1024.00 MB image at 159.10 MB/s Sep 18 00:47:34 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b is being set with open permissions: ugo+rw Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:34 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b Sep 18 00:47:34 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:34 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b" returned: 0 in 0.242s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-718eb2c5-fde4-4625-8537-57a5dbb8985b" released by "_copy_volume_from_snapshot" :: held 7.523s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-8a3ea952-6a5f-4def-bca1-f42fe938452c-718eb2c5-fde4-4625-8537-57a5dbb8985b" released by "_create_volume_from_snapshot" :: held 7.598s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.639s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.928s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=33fcbcec-9bb2-4abc-81b1-b91032ebf05e,created_at=2026-09-17T22:47:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1381422949',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=33fcbcec-9bb2-4abc-81b1-b91032ebf05e,host='devstack@QuobyteHD#QuobyteHD',id=5edd9f94-50be-4ac2-b9fa-598e5685776a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2368d88daf4a4a96b200f0fb6a9c95b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:26Z,use_quota=True,user_id='54e30b9892c64a1f8a0c067505bd4f42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d748b7c6-2289-4783-ab19-0e5a301b6593),volume_type_id=d748b7c6-2289-4783-ab19-0e5a301b6593)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Creating volume 5edd9f94-50be-4ac2-b9fa-598e5685776a {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:34 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:34 devstack sudo[103234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a 1073741824 Sep 18 00:47:34 devstack sudo[103234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77c66a83-db91-4449-9740-6ec6b4c65f33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-718eb2c5-fde4-4625-8537-57a5dbb8985b', 'volume_size': 1, 'snapshot_id': '8a3ea952-6a5f-4def-bca1-f42fe938452c'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba1d406-d4e9-439b-80ae-9a79d62fdd79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Volume volume-718eb2c5-fde4-4625-8537-57a5dbb8985b (718eb2c5-fde4-4625-8537-57a5dbb8985b): created successfully Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ba1d406-d4e9-439b-80ae-9a79d62fdd79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Flow 'volume_create_manager' (c7ee64c7-5c9f-4a24-af01-26c85ec88fb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:34 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6908a339-61f8-493f-a21d-1011823d5b82 tempest-VolumeDependencyTests-1379971897 None] Created volume successfully. Sep 18 00:47:34 devstack sudo[103234]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a 1073741824" returned: 0 in 0.421s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:34 devstack sudo[103239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a Sep 18 00:47:34 devstack sudo[103239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:35 devstack sudo[103239]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a" returned: 0 in 0.252s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] <== create_volume: return (712ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.733s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:47:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-116288210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef02fd22-03de-4bb2-a64f-92a69febf4d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a78ab64812624b19aa6e1f529497d887',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:47:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:47:24Z,use_quota=True,user_id='ca639e3b51ea4083926a1e13728a80db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e8fb1789-e222-43a2-91a3-090552c40ec2),volume_type_id=e8fb1789-e222-43a2-91a3-090552c40ec2)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Creating volume ef02fd22-03de-4bb2-a64f-92a69febf4d8 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:47:35 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84d5fb92-01ba-43f4-969c-1613240ce737) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5edd9f94-50be-4ac2-b9fa-598e5685776a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfebf670-80cb-4c5a-9404-22f92d0a3492) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:35 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 1073741824 Sep 18 00:47:35 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Volume volume-5edd9f94-50be-4ac2-b9fa-598e5685776a (5edd9f94-50be-4ac2-b9fa-598e5685776a): created successfully Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cfebf670-80cb-4c5a-9404-22f92d0a3492) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Flow 'volume_create_manager' (6be80c99-fbd0-4558-a715-e022eb8860fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7cdfa840-ed76-4ec9-b78a-dc4edfc3e141 tempest-GroupsTest-84461201 None] Created volume successfully. Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-8a3ea952-6a5f-4def-bca1-f42fe938452c-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-8a3ea952-6a5f-4def-bca1-f42fe938452c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-quobyte-0ab53017-24ff-4f1c-9cc3-61514944bb5d" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-0ab53017-24ff-4f1c-9cc3-61514944bb5d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-quobyte-8a3ea952-6a5f-4def-bca1-f42fe938452c" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-8a3ea952-6a5f-4def-bca1-f42fe938452c" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Deleting offline snapshot 8a3ea952-6a5f-4def-bca1-f42fe938452c of volume 0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] snapshot_file for this snap is: volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[75030cf6-d8fd-4e41-a791-e575cefdbf55]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:35 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 1073741824" returned: 0 in 0.492s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:35 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c Sep 18 00:47:35 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:35 devstack sudo[103249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 Sep 18 00:47:35 devstack sudo[103249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:35 devstack sudo[103249]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] <== create_volume: return (790ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.794s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:35 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c" returned: 0 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fcd7386-cb1b-4818-af05-784bd99bd010]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Attempting download of 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'metadata': {}}])) to volume ef02fd22-03de-4bb2-a64f-92a69febf4d8. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2db97c2-e504-4dc3-a5bc-1c5e360f548c]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_pipuoid1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:36 devstack sudo[103257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d Sep 18 00:47:36 devstack sudo[103257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:36 devstack sudo[103258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_pipuoid1 Sep 18 00:47:36 devstack sudo[103258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a98bc015-a268-4ef8-89f6-b1dd566c1c0f tempest-GroupsTest-84461201 None] Update group completed successfully. Sep 18 00:47:36 devstack sudo[103258]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_pipuoid1" returned: 0 in 0.376s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_pipuoid1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:36 devstack sudo[103265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_pipuoid1 Sep 18 00:47:36 devstack sudo[103265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:36 devstack sudo[103257]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d" returned: 0 in 0.603s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:36 devstack sudo[103268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c Sep 18 00:47:36 devstack sudo[103268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:36 devstack sudo[103265]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_pipuoid1" returned: 1 in 0.348s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_pipuoid1' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcbb9a1-beec-437e-89d5-15978748be4c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:36 devstack sudo[103272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD Sep 18 00:47:36 devstack sudo[103272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:36 devstack sudo[103268]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c" returned: 0 in 0.350s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:37 devstack sudo[103277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c Sep 18 00:47:37 devstack sudo[103277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:37 devstack sudo[103272]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD" returned: 0 in 0.336s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 was qcow2, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:37 devstack sudo[103282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 Sep 18 00:47:37 devstack sudo[103282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:37 devstack sudo[103277]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d.8a3ea952-6a5f-4def-bca1-f42fe938452c" returned: 0 in 0.270s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-8a3ea952-6a5f-4def-bca1-f42fe938452c" released by "_delete_snapshot" :: held 1.720s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-0ab53017-24ff-4f1c-9cc3-61514944bb5d" released by "delete_snapshot" :: held 1.748s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Created reservations ['e6cf9bf6-096f-4eb3-99ff-16c1908a9662', 'f595739e-0b1d-476a-8f0f-bef7136f98b7', '06f307e4-521b-48e5-94cf-0cdd84aa10d6', '45662809-cbe1-4fc0-9e88-e927f51f11e4'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Delete snapshot completed successfully. Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a4935072-ff12-4565-a745-da12fdca3658 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-8a3ea952-6a5f-4def-bca1-f42fe938452c-delete_snapshot" released by "delete_snapshot" :: held 1.902s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-0ab53017-24ff-4f1c-9cc3-61514944bb5d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-0ab53017-24ff-4f1c-9cc3-61514944bb5d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-quobyte-0ab53017-24ff-4f1c-9cc3-61514944bb5d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-0ab53017-24ff-4f1c-9cc3-61514944bb5d" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4daf9179-b859-4c7d-9f35-9e7fc9683803]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6e1f380f-1826-49d5-9260-d7a1cbd0d347 tempest-GroupsTest-84461201 None] Update group completed successfully. Sep 18 00:47:37 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d Sep 18 00:47:37 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:38 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d" returned: 0 in 0.422s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:38 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d Sep 18 00:47:38 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:38 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0ab53017-24ff-4f1c-9cc3-61514944bb5d" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-0ab53017-24ff-4f1c-9cc3-61514944bb5d" released by "delete_volume" :: held 0.764s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Created reservations ['58031db0-46db-4790-acaa-ddfcc2ed7129', '05d0f86c-f730-48af-9b5a-974e867aa126', '07d6f1d3-cf60-44b5-8450-591063b668d1', '7fe58670-7454-4397-ac3e-ba6eab09c29e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:38 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:38 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-718eb2c5-fde4-4625-8537-57a5dbb8985b-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-718eb2c5-fde4-4625-8537-57a5dbb8985b-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "cinder-quobyte-718eb2c5-fde4-4625-8537-57a5dbb8985b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-718eb2c5-fde4-4625-8537-57a5dbb8985b" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:39 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[45222e94-52bb-4a11-b3d6-bfee55610d33]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.373s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Deleted volume successfully. Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9ccd1ea6-cd2d-479e-971b-c213f94e5d0c tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-0ab53017-24ff-4f1c-9cc3-61514944bb5d-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:39 devstack sudo[103303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b Sep 18 00:47:39 devstack sudo[103303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:39 devstack sudo[103282]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8" returned: 0 in 2.201s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_0a7c836f-7f2f-49f6-9729-1ec63e6f3442_gaf64xs6devstack@QuobyteHD, size 112.00 MB, duration 2.20 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:47:39 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Converted 112.00 MB image at 50.86 MB/s Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:39 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 1G Sep 18 00:47:39 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:39 devstack sudo[103303]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b" returned: 0 in 0.452s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:39 devstack sudo[103310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b Sep 18 00:47:39 devstack sudo[103310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Acquiring lock "cinder-quobyte-5edd9f94-50be-4ac2-b9fa-598e5685776a" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Lock "cinder-quobyte-5edd9f94-50be-4ac2-b9fa-598e5685776a" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa3844b-9474-49c5-b0b9-3620a006a770]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:39 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 1G" returned: 0 in 0.388s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Downloaded image 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 ((None, [{'url': 'file:///opt/stack/data/glance/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'metadata': {}}])) to volume ef02fd22-03de-4bb2-a64f-92a69febf4d8 successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Temporary image 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 for user ca639e3b51ea4083926a1e13728a80db is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Marking volume ef02fd22-03de-4bb2-a64f-92a69febf4d8 as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Copying metadata from image 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 to ef02fd22-03de-4bb2-a64f-92a69febf4d8. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Creating volume glance metadata for volume ef02fd22-03de-4bb2-a64f-92a69febf4d8 backed by image 0a7c836f-7f2f-49f6-9729-1ec63e6f3442 with: {'image_id': '0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'image_name': 'tempest-scenario-img--2106466041', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:47:39 devstack sudo[103315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a Sep 18 00:47:39 devstack sudo[103315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f2aea65-7c06-4180-8e84-630120f3b73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8', 'volume_size': 1, 'image_id': '0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--2106466041', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'a78ab64812624b19aa6e1f529497d887', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '0a7c836f-7f2f-49f6-9729-1ec63e6f3442', 'created_at': datetime.datetime(2026, 9, 17, 22, 47, 20, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 47, 22, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/0a7c836f-7f2f-49f6-9729-1ec63e6f3442/file', 'properties': {}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:39 devstack sudo[103310]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb79144a-f10c-493f-b4f0-ef4a0de965f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-718eb2c5-fde4-4625-8537-57a5dbb8985b" returned: 0 in 0.311s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-quobyte-718eb2c5-fde4-4625-8537-57a5dbb8985b" released by "delete_volume" :: held 0.834s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:39 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Volume volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 (ef02fd22-03de-4bb2-a64f-92a69febf4d8): created successfully Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fb79144a-f10c-493f-b4f0-ef4a0de965f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Flow 'volume_create_manager' (a2519239-57d7-4226-b8d0-3884e2e504cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:47:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9c67fa4d-1b29-4d01-9810-906dd980b113 tempest-TestInstancesWithCinderVolumes-93885566 None] Created volume successfully. Sep 18 00:47:39 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Created reservations ['4990ba8f-e539-4757-b596-ca4ff7b3520b', '9206b584-7ea9-4abd-babf-2f75fbbd6f06', '29add2ac-694c-4da5-bc6f-235307b3633f', '2a03987c-bd28-4a67-a048-50e39bd9282b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:40 devstack sudo[103319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:40 devstack sudo[103319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:40 devstack sudo[103315]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a" returned: 0 in 0.489s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:40 devstack sudo[103323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a Sep 18 00:47:40 devstack sudo[103323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:40 devstack sudo[103319]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.309s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Deleted volume successfully. Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a557d506-f1dc-45f6-9895-fc55f5cb04b8 tempest-VolumeDependencyTests-1379971897 None] Lock "cinder-718eb2c5-fde4-4625-8537-57a5dbb8985b-delete_volume" released by "delete_volume" :: held 1.421s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:40 devstack sudo[103323]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5edd9f94-50be-4ac2-b9fa-598e5685776a" returned: 0 in 0.288s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Lock "cinder-quobyte-5edd9f94-50be-4ac2-b9fa-598e5685776a" released by "delete_volume" :: held 0.823s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Acquiring lock "cinder-quobyte-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Lock "cinder-quobyte-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a403c71b-dc7e-49b6-98ae-d7ea4e59c2c3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:40 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa Sep 18 00:47:40 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:40 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa" returned: 0 in 0.451s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:41 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa Sep 18 00:47:41 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:41 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa" returned: 0 in 0.315s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Lock "cinder-quobyte-a3ee0a35-1f6a-4e0c-8293-49c47b79fbaa" released by "delete_volume" :: held 0.823s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Created reservations ['a8b80201-24a0-4298-87ea-f9e486f23cc8'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:41 devstack cinder-volume[86526]: WARNING cinder.quota [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1853882230 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1853882230, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:47:41 devstack cinder-volume[86526]: WARNING cinder.quota [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1853882230 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1853882230, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Created reservations ['2256addc-147c-4574-a05a-c9ac5e607b20', '668a1efe-b318-403c-90d3-c6f9aab18816', 'dd145a4c-da83-444b-9b3c-90e67d45cfbd', 'cdbf9b33-7011-468a-859d-e504f1e9bcd5'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Created reservations ['3da330ba-f05e-4c42-8f86-e07385084f98', 'af0fd37f-5218-4174-be32-e78f53e8a6d8', '7d7050f8-ad2d-4fb0-a318-a2f688c14906', '4ecb5268-081c-42fa-9d42-0275be1318cb'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:41 devstack sudo[103341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:41 devstack sudo[103341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:42 devstack sudo[103341]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.303s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:42 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f0eb0f68-a511-4f2a-a2b5-374664eb7477 tempest-GroupsTest-84461201 None] Delete group completed successfully. Sep 18 00:47:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-964ad39f-0de7-429f-9512-c216e2a971bb req-daad5c2b-9484-4cf3-8d4e-6118f179c54b tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-964ad39f-0de7-429f-9512-c216e2a971bb req-daad5c2b-9484-4cf3-8d4e-6118f179c54b tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-964ad39f-0de7-429f-9512-c216e2a971bb req-daad5c2b-9484-4cf3-8d4e-6118f179c54b tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-964ad39f-0de7-429f-9512-c216e2a971bb req-daad5c2b-9484-4cf3-8d4e-6118f179c54b tempest-TestInstancesWithCinderVolumes-93885566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ce909601-87db-4565-b805-7e9e6c06cc2f', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:47:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-964ad39f-0de7-429f-9512-c216e2a971bb req-daad5c2b-9484-4cf3-8d4e-6118f179c54b tempest-TestInstancesWithCinderVolumes-93885566 None] attachment_update completed successfully. Sep 18 00:47:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3127da11-2d47-4c6c-bc43-d4ea4651995f tempest-GroupsV320Test-870220913 None] Group tempest-GroupsV320Test-Group-545549940: creating Sep 18 00:47:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3127da11-2d47-4c6c-bc43-d4ea4651995f tempest-GroupsV320Test-870220913 None] Group tempest-GroupsV320Test-Group-545549940: created successfully Sep 18 00:47:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3127da11-2d47-4c6c-bc43-d4ea4651995f tempest-GroupsV320Test-870220913 None] Create group completed successfully. Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Created reservations ['12ec615e-0533-4a29-9f49-09f5a8dd7ad0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:47:52 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:47:52 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:47:52 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:47:52 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:47:52 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0143397a-a050-4757-9d20-19cc38be2cde tempest-GroupsV320Test-870220913 None] Delete group completed successfully. Sep 18 00:48:02 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=89,cinder:UPDATE=81,cinder:DELETE=8,cinder:INSERT=23 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:48:02 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=92,cinder:UPDATE=100,cinder:INSERT=23,cinder:DELETE=3 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:04 devstack sudo[103841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:04 devstack sudo[103841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:04 devstack sudo[103841]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:48:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Flow 'volume_create_manager' (aaa32e31-8f02-4050-9896-b11e122e4a28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4fe011-134f-49d6-a99b-c98d29680e32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb4fe011-134f-49d6-a99b-c98d29680e32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-514000512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b927b091-3d56-426e-bded-b5ef27d7efed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc4caeb6154fdc9ae85910b806c805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:16Z,use_quota=True,user_id='1ffcf5415dd848778ae2d874f58a9cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028ea1f3-0efa-4908-9b41-9ac039e9bc95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (028ea1f3-0efa-4908-9b41-9ac039e9bc95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b230b7df-f950-4194-8a9d-b5340722e88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b230b7df-f950-4194-8a9d-b5340722e88f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b927b091-3d56-426e-bded-b5ef27d7efed', 'volume_name': 'volume-b927b091-3d56-426e-bded-b5ef27d7efed', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137e3c43-d088-4f3c-b485-1cc287d5c3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (137e3c43-d088-4f3c-b485-1cc287d5c3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b3af2e-b647-4475-b4ce-075beb0ea77f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Volume b927b091-3d56-426e-bded-b5ef27d7efed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b927b091-3d56-426e-bded-b5ef27d7efed', 'volume_size': 1} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-514000512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b927b091-3d56-426e-bded-b5ef27d7efed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc4caeb6154fdc9ae85910b806c805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:16Z,use_quota=True,user_id='1ffcf5415dd848778ae2d874f58a9cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Creating volume b927b091-3d56-426e-bded-b5ef27d7efed {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:15 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:15 devstack sudo[103931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed 1073741824 Sep 18 00:48:15 devstack sudo[103931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:16 devstack sudo[103931]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed 1073741824" returned: 0 in 0.502s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:16 devstack sudo[103944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed Sep 18 00:48:16 devstack sudo[103944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:16 devstack sudo[103944]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed" returned: 0 in 0.293s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8b3af2e-b647-4475-b4ce-075beb0ea77f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b927b091-3d56-426e-bded-b5ef27d7efed', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf35cd-23cd-4386-af88-5697635893e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Volume volume-b927b091-3d56-426e-bded-b5ef27d7efed (b927b091-3d56-426e-bded-b5ef27d7efed): created successfully Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51bf35cd-23cd-4386-af88-5697635893e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Flow 'volume_create_manager' (aaa32e31-8f02-4050-9896-b11e122e4a28) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-af4e8076-07c4-4b5e-8327-31002e13e30a tempest-VolumesListAdminTestJSON-2147268334 None] Created volume successfully. Sep 18 00:48:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-cdeca7ec-af35-4632-b136-6ea1aea9045c req-3361f4e0-02e5-482d-b70c-0d9c16d5c040 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-cdeca7ec-af35-4632-b136-6ea1aea9045c req-3361f4e0-02e5-482d-b70c-0d9c16d5c040 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-cdeca7ec-af35-4632-b136-6ea1aea9045c req-3361f4e0-02e5-482d-b70c-0d9c16d5c040 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-cdeca7ec-af35-4632-b136-6ea1aea9045c req-3361f4e0-02e5-482d-b70c-0d9c16d5c040 tempest-TestInstancesWithCinderVolumes-93885566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b4e69bb3-f568-4ca8-9c71-b7a39875a538', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:48:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-cdeca7ec-af35-4632-b136-6ea1aea9045c req-3361f4e0-02e5-482d-b70c-0d9c16d5c040 tempest-TestInstancesWithCinderVolumes-93885566 None] attachment_update completed successfully. Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Flow 'volume_create_manager' (82e2d61c-3a40-4483-b733-a7beee9b2996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4c16b0-0231-4ff3-9120-8badc1c9020b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d4c16b0-0231-4ff3-9120-8badc1c9020b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603514756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740f2a26-f546-4a61-a6af-efef9f1f097d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc4caeb6154fdc9ae85910b806c805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:18Z,use_quota=True,user_id='1ffcf5415dd848778ae2d874f58a9cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac085f5b-bc2d-4bac-b17f-cdb7b7ef7d84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac085f5b-bc2d-4bac-b17f-cdb7b7ef7d84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5595e9-4cab-4748-b7fb-723d3770616b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf5595e9-4cab-4748-b7fb-723d3770616b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '740f2a26-f546-4a61-a6af-efef9f1f097d', 'volume_name': 'volume-740f2a26-f546-4a61-a6af-efef9f1f097d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2ea5dc-d411-464d-99d1-1939c400eeb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba2ea5dc-d411-464d-99d1-1939c400eeb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d459ad-6739-4cd9-ba8d-b96c02398efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Volume 740f2a26-f546-4a61-a6af-efef9f1f097d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-740f2a26-f546-4a61-a6af-efef9f1f097d', 'volume_size': 1} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-603514756',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740f2a26-f546-4a61-a6af-efef9f1f097d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc4caeb6154fdc9ae85910b806c805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:18Z,use_quota=True,user_id='1ffcf5415dd848778ae2d874f58a9cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Creating volume 740f2a26-f546-4a61-a6af-efef9f1f097d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:18 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:18 devstack sudo[103966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d 1073741824 Sep 18 00:48:18 devstack sudo[103966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:18 devstack sudo[103966]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d 1073741824" returned: 0 in 0.472s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:19 devstack sudo[103974]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d Sep 18 00:48:19 devstack sudo[103974]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-dd476daf-0250-4cfa-9733-32656b863223 req-983af1ee-bcda-473b-bdb1-350f23ad0b18 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:19 devstack sudo[103974]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] <== create_volume: return (770ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.773s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-dd476daf-0250-4cfa-9733-32656b863223 req-983af1ee-bcda-473b-bdb1-350f23ad0b18 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.042s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4d459ad-6739-4cd9-ba8d-b96c02398efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740f2a26-f546-4a61-a6af-efef9f1f097d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06329c0f-25d1-4a8f-b45a-dd5fcaf8217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-dd476daf-0250-4cfa-9733-32656b863223 req-983af1ee-bcda-473b-bdb1-350f23ad0b18 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Volume volume-740f2a26-f546-4a61-a6af-efef9f1f097d (740f2a26-f546-4a61-a6af-efef9f1f097d): created successfully Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06329c0f-25d1-4a8f-b45a-dd5fcaf8217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Flow 'volume_create_manager' (82e2d61c-3a40-4483-b733-a7beee9b2996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ee5ce1f0-46af-4f25-a3d8-3af38b89d7ce tempest-VolumesListAdminTestJSON-2147268334 None] Created volume successfully. Sep 18 00:48:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-dd476daf-0250-4cfa-9733-32656b863223 req-983af1ee-bcda-473b-bdb1-350f23ad0b18 tempest-TestInstancesWithCinderVolumes-93885566 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '90366026-d955-480f-bd08-fd6a301ca39e', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:48:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-dd476daf-0250-4cfa-9733-32656b863223 req-983af1ee-bcda-473b-bdb1-350f23ad0b18 tempest-TestInstancesWithCinderVolumes-93885566 None] attachment_update completed successfully. Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Flow 'volume_create_manager' (17b02cb9-e72a-4972-9b7f-7ccac0c808c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391ed554-0894-4fbd-a9de-27184194e1a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (391ed554-0894-4fbd-a9de-27184194e1a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-673513951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5ccc47-ca93-4045-845e-e01772b27067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc4caeb6154fdc9ae85910b806c805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:20Z,use_quota=True,user_id='1ffcf5415dd848778ae2d874f58a9cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d8beff-8949-4216-8435-072d9efaab87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16d8beff-8949-4216-8435-072d9efaab87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68595f23-dc0f-4651-9205-eefc4a4a1f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (68595f23-dc0f-4651-9205-eefc4a4a1f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5ccc47-ca93-4045-845e-e01772b27067', 'volume_name': 'volume-0a5ccc47-ca93-4045-845e-e01772b27067', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358c3a2c-2160-42e7-95a8-bf42339608fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (358c3a2c-2160-42e7-95a8-bf42339608fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac38532-5372-4717-8693-f5b65c3e9e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Volume 0a5ccc47-ca93-4045-845e-e01772b27067: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5ccc47-ca93-4045-845e-e01772b27067', 'volume_size': 1} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-673513951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5ccc47-ca93-4045-845e-e01772b27067,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f8fc4caeb6154fdc9ae85910b806c805',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:20Z,use_quota=True,user_id='1ffcf5415dd848778ae2d874f58a9cd2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Creating volume 0a5ccc47-ca93-4045-845e-e01772b27067 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:20 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:20 devstack sudo[103985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 1073741824 Sep 18 00:48:20 devstack sudo[103985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:20 devstack sudo[103985]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 1073741824" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:20 devstack sudo[103999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 Sep 18 00:48:20 devstack sudo[103999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:20 devstack sudo[103999]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aac38532-5372-4717-8693-f5b65c3e9e12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5ccc47-ca93-4045-845e-e01772b27067', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaee2c1-bd65-488a-96b9-1baed53be7e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Volume volume-0a5ccc47-ca93-4045-845e-e01772b27067 (0a5ccc47-ca93-4045-845e-e01772b27067): created successfully Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5eaee2c1-bd65-488a-96b9-1baed53be7e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Flow 'volume_create_manager' (17b02cb9-e72a-4972-9b7f-7ccac0c808c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ea17ac2a-e367-459c-9f7d-9d29277db83b tempest-VolumesListAdminTestJSON-2147268334 None] Created volume successfully. Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Flow 'volume_create_manager' (05657420-aa7f-49f6-b7df-5f4af4e53198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84b7742-9bfc-493b-9832-da653ddb4015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b84b7742-9bfc-493b-9832-da653ddb4015) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc772c9-ff02-458b-a06b-d6f6a71794b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e134e7c21bb544aa8eed28f8555adf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:22Z,use_quota=True,user_id='ada29211a2c04dd5bd3c2a9ab4a5c3c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08da0561-91d2-4982-a09d-940a1a90f1ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (08da0561-91d2-4982-a09d-940a1a90f1ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bedb24-e515-460f-b68d-25a04fda6ec6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34bedb24-e515-460f-b68d-25a04fda6ec6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7fc772c9-ff02-458b-a06b-d6f6a71794b3', 'volume_name': 'volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894a901f-2930-41b0-9b8a-c4477854bc1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (894a901f-2930-41b0-9b8a-c4477854bc1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c70d6d-897f-47a4-8a8a-6b29451dedd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Volume 7fc772c9-ff02-458b-a06b-d6f6a71794b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3', 'volume_size': 1} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:21Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7fc772c9-ff02-458b-a06b-d6f6a71794b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e134e7c21bb544aa8eed28f8555adf5e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:22Z,use_quota=True,user_id='ada29211a2c04dd5bd3c2a9ab4a5c3c0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Creating volume 7fc772c9-ff02-458b-a06b-d6f6a71794b3 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:21 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:21 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 1073741824 Sep 18 00:48:21 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:22 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 1073741824" returned: 0 in 0.486s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:22 devstack sudo[104013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 Sep 18 00:48:22 devstack sudo[104013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:22 devstack sudo[104013]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3" returned: 0 in 0.244s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73c70d6d-897f-47a4-8a8a-6b29451dedd6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2a61fc-bd51-41bf-baf8-e42153913ef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Volume volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 (7fc772c9-ff02-458b-a06b-d6f6a71794b3): created successfully Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4c2a61fc-bd51-41bf-baf8-e42153913ef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Flow 'volume_create_manager' (05657420-aa7f-49f6-b7df-5f4af4e53198) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-46226606-a01f-4355-8b40-1d14fcfc0588 tempest-VolumesListAdminTestJSON-884953530 None] Created volume successfully. Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Acquiring lock "cinder-7fc772c9-ff02-458b-a06b-d6f6a71794b3-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Lock "cinder-7fc772c9-ff02-458b-a06b-d6f6a71794b3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Acquiring lock "cinder-quobyte-7fc772c9-ff02-458b-a06b-d6f6a71794b3" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Lock "cinder-quobyte-7fc772c9-ff02-458b-a06b-d6f6a71794b3" acquired by "delete_volume" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d63d47-8673-4a47-8822-676c370d22a3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "cinder-0a5ccc47-ca93-4045-845e-e01772b27067-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-0a5ccc47-ca93-4045-845e-e01772b27067-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "cinder-quobyte-0a5ccc47-ca93-4045-845e-e01772b27067" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-quobyte-0a5ccc47-ca93-4045-845e-e01772b27067" acquired by "delete_volume" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4635784-8f30-4421-ad30-9bb09d1599eb]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:23 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 Sep 18 00:48:23 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:23 devstack sudo[104033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 Sep 18 00:48:23 devstack sudo[104033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:23 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3" returned: 0 in 0.476s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:23 devstack sudo[104042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3 Sep 18 00:48:23 devstack sudo[104042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:23 devstack sudo[104033]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067" returned: 0 in 0.430s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:23 devstack sudo[104047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067 Sep 18 00:48:23 devstack sudo[104047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:23 devstack sudo[104042]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7fc772c9-ff02-458b-a06b-d6f6a71794b3" returned: 0 in 0.325s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Lock "cinder-quobyte-7fc772c9-ff02-458b-a06b-d6f6a71794b3" released by "delete_volume" :: held 0.862s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Created reservations ['0db944ad-b6c2-4faa-8f82-cd549dbfcffe', '6dea0750-9480-4908-8d28-dd57c76ad4e2', 'ca2f98fb-9e30-42c0-a5ae-3efc58b79f8f', 'c754b455-02b4-464c-82b7-d84103a1447c'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:23 devstack sudo[104047]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0a5ccc47-ca93-4045-845e-e01772b27067" returned: 0 in 0.306s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-quobyte-0a5ccc47-ca93-4045-845e-e01772b27067" released by "delete_volume" :: held 0.795s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:23 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Created reservations ['79cc9d0d-29f1-4c5a-92ee-4bc491874ab6', '431a2bf6-0c74-4677-9c48-1a3263b2de98', 'fcdeefe1-a6f5-4133-8468-b0544aaa1b5e', '180a6804-3bf4-407a-a68f-0fc02ba799b4'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:23 devstack sudo[104053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:23 devstack sudo[104053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-cacc1a73-9ccb-4433-8c23-62d4f67edba4 req-b4650c28-68ef-477a-b96e-43980a8599ee tempest-TestInstancesWithCinderVolumes-93885566 None] Terminate volume connection completed successfully. Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-cacc1a73-9ccb-4433-8c23-62d4f67edba4 req-b4650c28-68ef-477a-b96e-43980a8599ee tempest-TestInstancesWithCinderVolumes-93885566 None] Deleting attachment b4e69bb3-f568-4ca8-9c71-b7a39875a538. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:24 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:24 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:24 devstack sudo[104053]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.294s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Deleted volume successfully. Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d317f954-d43b-43f9-8803-3a90b88f0f8a tempest-VolumesListAdminTestJSON-884953530 None] Lock "cinder-7fc772c9-ff02-458b-a06b-d6f6a71794b3-delete_volume" released by "delete_volume" :: held 1.415s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "cinder-740f2a26-f546-4a61-a6af-efef9f1f097d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-740f2a26-f546-4a61-a6af-efef9f1f097d-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:24 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.321s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "cinder-quobyte-740f2a26-f546-4a61-a6af-efef9f1f097d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Deleted volume successfully. Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-quobyte-740f2a26-f546-4a61-a6af-efef9f1f097d" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fd9b2722-e0d9-41ca-b078-e9895474879d tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-0a5ccc47-ca93-4045-845e-e01772b27067-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c22dde-8329-494a-a00c-356873d554f0]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:24 devstack sudo[104060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d Sep 18 00:48:24 devstack sudo[104060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:24 devstack sudo[104060]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "cinder-b8865cc8-352e-409c-bbf6-ba23baa7f7c1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:24 devstack sudo[104065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d Sep 18 00:48:24 devstack sudo[104065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-b8865cc8-352e-409c-bbf6-ba23baa7f7c1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "cinder-quobyte-b8865cc8-352e-409c-bbf6-ba23baa7f7c1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-quobyte-b8865cc8-352e-409c-bbf6-ba23baa7f7c1" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d7db184-590b-4f27-aee2-38786c11773f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:25 devstack sudo[104071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 Sep 18 00:48:25 devstack sudo[104071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:25 devstack sudo[104065]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-740f2a26-f546-4a61-a6af-efef9f1f097d" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-quobyte-740f2a26-f546-4a61-a6af-efef9f1f097d" released by "delete_volume" :: held 0.725s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Created reservations ['0ab5b662-fc28-4c78-ac67-e05e6525ec1f', '82cdf309-9255-4a9d-a8b5-da87f427d2d7', '7d814e5c-7c1e-4a41-9693-4bb03b2d1df4', '8e43d4c9-7068-4699-9480-8b804e6c7d39'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:25 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:25 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:25 devstack sudo[104071]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1" returned: 0 in 0.422s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:25 devstack sudo[104079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1 Sep 18 00:48:25 devstack sudo[104079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:25 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.302s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Deleted volume successfully. Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "cinder-b927b091-3d56-426e-bded-b5ef27d7efed-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-59329cdb-52a6-4b69-95c7-8e3d81d86b01 tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-740f2a26-f546-4a61-a6af-efef9f1f097d-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-b927b091-3d56-426e-bded-b5ef27d7efed-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:25 devstack sudo[104079]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "cinder-quobyte-b927b091-3d56-426e-bded-b5ef27d7efed" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b8865cc8-352e-409c-bbf6-ba23baa7f7c1" returned: 0 in 0.300s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-quobyte-b8865cc8-352e-409c-bbf6-ba23baa7f7c1" released by "delete_volume" :: held 0.774s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-quobyte-b927b091-3d56-426e-bded-b5ef27d7efed" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f41c1877-ccaf-42e5-ba9b-812d387eec44]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:25 devstack cinder-volume[86526]: WARNING cinder.quota [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521291994-1446381898 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521291994-1446381898, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:48:25 devstack cinder-volume[86526]: WARNING cinder.quota [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521291994-1446381898 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-521291994-1446381898, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Created reservations ['8f387872-9f2f-415d-a3cc-80c5f7f34c10', '179d826a-166c-4274-ba24-4884b159771c', 'dc3394de-9cf0-4ab0-be31-508f428a210f', '8dfaadf8-fcdd-4838-a54a-5a875f3aed52'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:25 devstack sudo[104083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed Sep 18 00:48:25 devstack sudo[104083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:25 devstack sudo[104085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:25 devstack sudo[104085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:26 devstack sudo[104083]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:26 devstack sudo[104085]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed" returned: 0 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:26 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Deleted volume successfully. Sep 18 00:48:26 devstack sudo[104091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed Sep 18 00:48:26 devstack sudo[104091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1f285cca-7f5e-4993-9e19-3652951f5825 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-b8865cc8-352e-409c-bbf6-ba23baa7f7c1-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:26 devstack sudo[104091]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b927b091-3d56-426e-bded-b5ef27d7efed" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-quobyte-b927b091-3d56-426e-bded-b5ef27d7efed" released by "delete_volume" :: held 0.708s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Created reservations ['ba3d9f84-2dff-4daa-9de8-9bb78a1a9e56', '3c2bf91f-b8e0-4d85-acf4-0776c2d9cabd', '2ca4f56f-699d-4314-bba8-34f56b52c385', 'a20da010-f6c1-449b-ab96-63b584216071'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:26 devstack sudo[104094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:26 devstack sudo[104094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:26 devstack sudo[104094]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.312s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:26 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Deleted volume successfully. Sep 18 00:48:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d160cd59-62d9-49e7-85da-fc7ed435176a tempest-VolumesListAdminTestJSON-2147268334 None] Lock "cinder-b927b091-3d56-426e-bded-b5ef27d7efed-delete_volume" released by "delete_volume" :: held 1.267s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-ecfa9d58-605c-42f1-a034-72111a0dd956 req-393ce766-3394-4aad-ab79-6ac46d663d36 tempest-TestInstancesWithCinderVolumes-93885566 None] Terminate volume connection completed successfully. Sep 18 00:48:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-ecfa9d58-605c-42f1-a034-72111a0dd956 req-393ce766-3394-4aad-ab79-6ac46d663d36 tempest-TestInstancesWithCinderVolumes-93885566 None] Deleting attachment 90366026-d955-480f-bd08-fd6a301ca39e. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:48:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "cinder-837b4526-ddbf-4167-bc1f-5c8a50bb9e09-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-837b4526-ddbf-4167-bc1f-5c8a50bb9e09-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "cinder-quobyte-837b4526-ddbf-4167-bc1f-5c8a50bb9e09" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-quobyte-837b4526-ddbf-4167-bc1f-5c8a50bb9e09" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[98a91cb6-af8f-4b21-a4ed-6b86e0e07518]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:29 devstack sudo[104121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 Sep 18 00:48:29 devstack sudo[104121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:30 devstack sudo[104121]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09" returned: 0 in 0.412s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:30 devstack sudo[104126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09 Sep 18 00:48:30 devstack sudo[104126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:30 devstack sudo[104126]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-837b4526-ddbf-4167-bc1f-5c8a50bb9e09" returned: 0 in 0.270s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-quobyte-837b4526-ddbf-4167-bc1f-5c8a50bb9e09" released by "delete_volume" :: held 0.739s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:30 devstack cinder-volume[86526]: WARNING cinder.quota [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1970620120-1136970497 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1970620120-1136970497, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:48:30 devstack cinder-volume[86526]: WARNING cinder.quota [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1970620120-1136970497 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1970620120-1136970497, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Created reservations ['694a412e-7883-4c26-8477-81697b8600c6', 'cd29bee7-fbe8-400a-b7d8-5c1b30f70272', 'a2a47b13-a1a6-4769-91da-fff07b8df5e5', '3823263b-91fb-40f2-a218-fa8ee5378f7a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:30 devstack sudo[104129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:30 devstack sudo[104129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:30 devstack sudo[104129]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:30 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Deleted volume successfully. Sep 18 00:48:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-2e3ca2c5-dcb4-4e73-b810-48be05f994c2 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-837b4526-ddbf-4167-bc1f-5c8a50bb9e09-delete_volume" released by "delete_volume" :: held 1.275s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Flow 'volume_create_manager' (d68f3af7-b744-4c96-9f51-1bf5e834dea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839f220-b14e-4ae1-97e1-7652e5b93b1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d839f220-b14e-4ae1-97e1-7652e5b93b1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-803035004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d1ea91-ee58-4d15-8267-2c706ff4469e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294b54566ea54235b7a4d674b3f64473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:32Z,use_quota=True,user_id='182fc338a31f43929973dc1756f3f4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff370dd-f9a3-458f-853d-44445a99855c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ff370dd-f9a3-458f-853d-44445a99855c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9151a83-f493-405c-969e-a6877b22b500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9151a83-f493-405c-969e-a6877b22b500) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98d1ea91-ee58-4d15-8267-2c706ff4469e', 'volume_name': 'volume-98d1ea91-ee58-4d15-8267-2c706ff4469e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f76214-39bd-42fc-92b7-f40505f38181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f76214-39bd-42fc-92b7-f40505f38181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ba9048-ae5c-4152-9172-8624b57e8391) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Volume 98d1ea91-ee58-4d15-8267-2c706ff4469e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98d1ea91-ee58-4d15-8267-2c706ff4469e', 'volume_size': 1} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-803035004',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=98d1ea91-ee58-4d15-8267-2c706ff4469e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='294b54566ea54235b7a4d674b3f64473',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:32Z,use_quota=True,user_id='182fc338a31f43929973dc1756f3f4d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Creating volume 98d1ea91-ee58-4d15-8267-2c706ff4469e {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:32 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:32 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e 1073741824 Sep 18 00:48:32 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:32 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e 1073741824" returned: 0 in 0.643s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:32 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e Sep 18 00:48:32 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:33 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e" returned: 0 in 0.299s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.999s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (79ba9048-ae5c-4152-9172-8624b57e8391) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98d1ea91-ee58-4d15-8267-2c706ff4469e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1194fe06-b560-4f30-abc9-e2ce07dc4755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Volume volume-98d1ea91-ee58-4d15-8267-2c706ff4469e (98d1ea91-ee58-4d15-8267-2c706ff4469e): created successfully Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1194fe06-b560-4f30-abc9-e2ce07dc4755) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Flow 'volume_create_manager' (d68f3af7-b744-4c96-9f51-1bf5e834dea7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2e24f3bb-da00-409f-ac3f-d5912f12d132 tempest-VolumesMetadataTest-502712768 None] Created volume successfully. Sep 18 00:48:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-452d2225-ab24-4a82-8220-8e77eea7d9b6 req-8a109f24-fc54-4342-82b5-6a302c282a84 tempest-TestInstancesWithCinderVolumes-93885566 None] Terminate volume connection completed successfully. Sep 18 00:48:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-452d2225-ab24-4a82-8220-8e77eea7d9b6 req-8a109f24-fc54-4342-82b5-6a302c282a84 tempest-TestInstancesWithCinderVolumes-93885566 None] Deleting attachment ce909601-87db-4565-b805-7e9e6c06cc2f. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "cinder-ef02fd22-03de-4bb2-a64f-92a69febf4d8-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-ef02fd22-03de-4bb2-a64f-92a69febf4d8-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "cinder-quobyte-ef02fd22-03de-4bb2-a64f-92a69febf4d8" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-quobyte-ef02fd22-03de-4bb2-a64f-92a69febf4d8" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4a27af-ee70-4c37-8958-7ce7bdd28359]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Acquiring lock "cinder-98d1ea91-ee58-4d15-8267-2c706ff4469e-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:34 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 Sep 18 00:48:34 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Lock "cinder-98d1ea91-ee58-4d15-8267-2c706ff4469e-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Acquiring lock "cinder-quobyte-98d1ea91-ee58-4d15-8267-2c706ff4469e" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Lock "cinder-quobyte-98d1ea91-ee58-4d15-8267-2c706ff4469e" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7cf20aa-7d0b-4111-a42e-d85353810f6f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:35 devstack sudo[104172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e Sep 18 00:48:35 devstack sudo[104172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:35 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8" returned: 0 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:35 devstack sudo[104177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8 Sep 18 00:48:35 devstack sudo[104177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:35 devstack sudo[104172]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:35 devstack sudo[104183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e Sep 18 00:48:35 devstack sudo[104183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:35 devstack sudo[104177]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ef02fd22-03de-4bb2-a64f-92a69febf4d8" returned: 0 in 0.252s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-quobyte-ef02fd22-03de-4bb2-a64f-92a69febf4d8" released by "delete_volume" :: held 0.709s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:35 devstack cinder-volume[86526]: WARNING cinder.quota [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477635511-395640745 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477635511-395640745, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:48:35 devstack cinder-volume[86526]: WARNING cinder.quota [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477635511-395640745 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1477635511-395640745, it is now deprecated. Please use the default quota class for default quota. Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Created reservations ['e81d2914-539f-4858-ad00-24f0295f55e8', '7217a6a4-eb0c-4fb4-a320-7556e620c092', '8911f777-967d-455d-b3d6-bca72c2e7ddc', '49c491f9-7acd-4687-bdf5-b88239fb3fbc'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:35 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:35 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:35 devstack sudo[104183]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-98d1ea91-ee58-4d15-8267-2c706ff4469e" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Lock "cinder-quobyte-98d1ea91-ee58-4d15-8267-2c706ff4469e" released by "delete_volume" :: held 0.684s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Created reservations ['f499f508-5b96-4785-a434-d40f54e7e2ca', 'a25f7693-ed7e-42fb-a12d-758526d2923f', 'e8e4f8f6-5f05-4223-86c0-87cfcfe15a88', '2a43756b-134f-4e51-9f0a-2b15348bbf73'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:35 devstack sudo[104188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:35 devstack sudo[104188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:35 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Deleted volume successfully. Sep 18 00:48:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0b0c5194-c425-4a12-83ad-6db47bf08d58 tempest-TestInstancesWithCinderVolumes-93885566 None] Lock "cinder-ef02fd22-03de-4bb2-a64f-92a69febf4d8-delete_volume" released by "delete_volume" :: held 1.192s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:36 devstack sudo[104188]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.285s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:36 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Deleted volume successfully. Sep 18 00:48:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b833dc1b-7462-448c-80c9-4dabd1a9519a tempest-VolumesMetadataTest-502712768 None] Lock "cinder-98d1ea91-ee58-4d15-8267-2c706ff4469e-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Flow 'volume_create_manager' (edb23fc7-3294-44b1-bce6-3f552ae4fbb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fac20ad-1782-43f8-a240-f4a77128e72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6fac20ad-1782-43f8-a240-f4a77128e72e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1891952257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ab62c7-79e3-487e-b808-1ab2f5362165,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a845502fec6e4a2a8fbdfb38b1117671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:40Z,use_quota=True,user_id='f2f8fe4fd93b4d4d8ae8b68df5b01fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e14a27-4317-4f85-a623-fd69c0d0af47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11e14a27-4317-4f85-a623-fd69c0d0af47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a99573-3148-4bc1-86ad-3a6fa5e3926a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b0a99573-3148-4bc1-86ad-3a6fa5e3926a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28ab62c7-79e3-487e-b808-1ab2f5362165', 'volume_name': 'volume-28ab62c7-79e3-487e-b808-1ab2f5362165', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cbef79-d038-467c-b3ea-a46ca31ea61e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (51cbef79-d038-467c-b3ea-a46ca31ea61e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f50132-feec-4fb8-a544-0e25df5e9d47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:39 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Volume 28ab62c7-79e3-487e-b808-1ab2f5362165: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28ab62c7-79e3-487e-b808-1ab2f5362165', 'volume_size': 1} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1891952257',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28ab62c7-79e3-487e-b808-1ab2f5362165,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a845502fec6e4a2a8fbdfb38b1117671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:40Z,use_quota=True,user_id='f2f8fe4fd93b4d4d8ae8b68df5b01fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Creating volume 28ab62c7-79e3-487e-b808-1ab2f5362165 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:39 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:39 devstack sudo[104197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 1073741824 Sep 18 00:48:39 devstack sudo[104197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:40 devstack sudo[104197]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 1073741824" returned: 0 in 0.534s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:40 devstack sudo[104203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 Sep 18 00:48:40 devstack sudo[104203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:40 devstack sudo[104203]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165" returned: 0 in 0.287s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] <== create_volume: return (862ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f50132-feec-4fb8-a544-0e25df5e9d47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28ab62c7-79e3-487e-b808-1ab2f5362165', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f9c33a-ed36-4105-8599-b034c2b37580) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:40 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Volume volume-28ab62c7-79e3-487e-b808-1ab2f5362165 (28ab62c7-79e3-487e-b808-1ab2f5362165): created successfully Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (22f9c33a-ed36-4105-8599-b034c2b37580) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Flow 'volume_create_manager' (edb23fc7-3294-44b1-bce6-3f552ae4fbb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-eaf35da7-47bc-4ee1-8ec1-51e3240d6290 tempest-VolumesListTestJSON-546782007 None] Created volume successfully. Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Flow 'volume_create_manager' (ef8e7682-781b-4f3e-9271-6eb055932982) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2156bfb6-cc21-49a9-a905-9232d0d7e29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2156bfb6-cc21-49a9-a905-9232d0d7e29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1960921021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c4dc4f-e57d-4d06-9216-3f7bd922f1bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a845502fec6e4a2a8fbdfb38b1117671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:42Z,use_quota=True,user_id='f2f8fe4fd93b4d4d8ae8b68df5b01fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced94ae-f165-484f-a1b9-d90922533785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ced94ae-f165-484f-a1b9-d90922533785) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5541625-77cc-465f-bbc7-1ccaa075a0b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5541625-77cc-465f-bbc7-1ccaa075a0b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97c4dc4f-e57d-4d06-9216-3f7bd922f1bd', 'volume_name': 'volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363e5274-19b9-4d1d-b350-87375803b87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (363e5274-19b9-4d1d-b350-87375803b87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ba0237-7860-4f8f-8fb5-60587c1e9543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:42 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Volume 97c4dc4f-e57d-4d06-9216-3f7bd922f1bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd', 'volume_size': 1} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1960921021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97c4dc4f-e57d-4d06-9216-3f7bd922f1bd,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a845502fec6e4a2a8fbdfb38b1117671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:42Z,use_quota=True,user_id='f2f8fe4fd93b4d4d8ae8b68df5b01fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Creating volume 97c4dc4f-e57d-4d06-9216-3f7bd922f1bd {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:42 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:42 devstack sudo[104209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd 1073741824 Sep 18 00:48:42 devstack sudo[104209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:43 devstack sudo[104209]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd 1073741824" returned: 0 in 0.432s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:43 devstack sudo[104215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd Sep 18 00:48:43 devstack sudo[104215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:43 devstack sudo[104215]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd" returned: 0 in 0.286s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.768s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (87ba0237-7860-4f8f-8fb5-60587c1e9543) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcad652-d020-4d38-abfd-59c6f387196a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:43 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Volume volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd (97c4dc4f-e57d-4d06-9216-3f7bd922f1bd): created successfully Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fcad652-d020-4d38-abfd-59c6f387196a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:43 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Flow 'volume_create_manager' (ef8e7682-781b-4f3e-9271-6eb055932982) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ef7602f9-a6aa-4d46-8063-7a00940df107 tempest-VolumesListTestJSON-546782007 None] Created volume successfully. Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Flow 'volume_create_manager' (0ad680df-1cd1-493f-806b-8ff28ed68f83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1941a152-b7d1-471c-9c65-9415bc52aba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1941a152-b7d1-471c-9c65-9415bc52aba4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-274321938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fc7e45-d2cf-455e-8d36-0410555b1da4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a845502fec6e4a2a8fbdfb38b1117671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:44Z,use_quota=True,user_id='f2f8fe4fd93b4d4d8ae8b68df5b01fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8134bfd-c6ab-4442-b470-650e0d9a6dee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8134bfd-c6ab-4442-b470-650e0d9a6dee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c484271-300a-43dc-85a5-f0af9c3932b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c484271-300a-43dc-85a5-f0af9c3932b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16fc7e45-d2cf-455e-8d36-0410555b1da4', 'volume_name': 'volume-16fc7e45-d2cf-455e-8d36-0410555b1da4', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd23cdb6-09cd-4105-a484-0b250b2eadf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd23cdb6-09cd-4105-a484-0b250b2eadf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76bab5e-f419-4a2c-bad0-b11fbc6250db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:44 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Volume 16fc7e45-d2cf-455e-8d36-0410555b1da4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16fc7e45-d2cf-455e-8d36-0410555b1da4', 'volume_size': 1} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:48:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-274321938',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16fc7e45-d2cf-455e-8d36-0410555b1da4,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='a845502fec6e4a2a8fbdfb38b1117671',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:48:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:48:44Z,use_quota=True,user_id='f2f8fe4fd93b4d4d8ae8b68df5b01fbf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Creating volume 16fc7e45-d2cf-455e-8d36-0410555b1da4 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:48:44 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:44 devstack sudo[104218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 1073741824 Sep 18 00:48:44 devstack sudo[104218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:44 devstack sudo[104218]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 1073741824" returned: 0 in 0.470s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:44 devstack sudo[104226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 Sep 18 00:48:44 devstack sudo[104226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:44 devstack sudo[104226]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e76bab5e-f419-4a2c-bad0-b11fbc6250db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16fc7e45-d2cf-455e-8d36-0410555b1da4', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3c508c-8b1f-4b51-9319-48f71c5c40ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:48:44 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Volume volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 (16fc7e45-d2cf-455e-8d36-0410555b1da4): created successfully Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0d3c508c-8b1f-4b51-9319-48f71c5c40ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:48:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Flow 'volume_create_manager' (0ad680df-1cd1-493f-806b-8ff28ed68f83) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:48:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ccb75122-6cc8-4655-b4c6-fa22bc5d885b tempest-VolumesListTestJSON-546782007 None] Created volume successfully. Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Acquiring lock "cinder-16fc7e45-d2cf-455e-8d36-0410555b1da4-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Lock "cinder-16fc7e45-d2cf-455e-8d36-0410555b1da4-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Acquiring lock "cinder-quobyte-16fc7e45-d2cf-455e-8d36-0410555b1da4" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Lock "cinder-quobyte-16fc7e45-d2cf-455e-8d36-0410555b1da4" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0c59c192-d3b8-4eb0-a4e0-839eed5442ea]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:47 devstack sudo[104230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 Sep 18 00:48:47 devstack sudo[104230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:47 devstack sudo[104230]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4" returned: 0 in 0.376s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:47 devstack sudo[104235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4 Sep 18 00:48:47 devstack sudo[104235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:47 devstack sudo[104235]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16fc7e45-d2cf-455e-8d36-0410555b1da4" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Lock "cinder-quobyte-16fc7e45-d2cf-455e-8d36-0410555b1da4" released by "delete_volume" :: held 0.689s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Created reservations ['fcda2708-14cf-4443-9264-9cbc5842eada', '08ee9df7-7fae-4d8d-984b-49a30a70c30e', '9eb4e4ac-f4e9-4a36-b3cd-245769cc8ef3', 'fe9e0a25-f4f5-449e-8b4c-677ffc841656'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:48 devstack sudo[104238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:48 devstack sudo[104238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:48 devstack sudo[104238]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Deleted volume successfully. Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d1451b0b-37dc-4e2e-aa02-7c94638de09a tempest-VolumesListTestJSON-546782007 None] Lock "cinder-16fc7e45-d2cf-455e-8d36-0410555b1da4-delete_volume" released by "delete_volume" :: held 1.188s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Acquiring lock "cinder-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Lock "cinder-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Acquiring lock "cinder-quobyte-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Lock "cinder-quobyte-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e865a4-d79e-48c3-a77b-3cbf0c6757ae]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:48 devstack sudo[104241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd Sep 18 00:48:48 devstack sudo[104241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:48 devstack sudo[104241]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:48 devstack sudo[104246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd Sep 18 00:48:48 devstack sudo[104246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:49 devstack sudo[104246]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd" returned: 0 in 0.246s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Lock "cinder-quobyte-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd" released by "delete_volume" :: held 0.706s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Created reservations ['4d802054-4fe8-4768-a522-28cb464ed36b', 'dcfd9278-8ca4-4b0f-9331-2a3e450ba33b', '5e6c9dee-4bc7-4e92-8391-c12a39e50834', 'c335ffaf-3bcd-413c-8abe-da38d86379b0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:49 devstack sudo[104249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:49 devstack sudo[104249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:49 devstack sudo[104249]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.269s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Deleted volume successfully. Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-18068855-e4af-4979-b43e-6878304287ee tempest-VolumesListTestJSON-546782007 None] Lock "cinder-97c4dc4f-e57d-4d06-9216-3f7bd922f1bd-delete_volume" released by "delete_volume" :: held 1.211s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Acquiring lock "cinder-28ab62c7-79e3-487e-b808-1ab2f5362165-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Lock "cinder-28ab62c7-79e3-487e-b808-1ab2f5362165-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Acquiring lock "cinder-quobyte-28ab62c7-79e3-487e-b808-1ab2f5362165" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Lock "cinder-quobyte-28ab62c7-79e3-487e-b808-1ab2f5362165" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9af1fed-8884-4310-9aa0-81572a1db575]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:48:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:49 devstack sudo[104252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 Sep 18 00:48:49 devstack sudo[104252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:50 devstack sudo[104252]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165" returned: 0 in 0.373s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:50 devstack sudo[104257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165 Sep 18 00:48:50 devstack sudo[104257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:50 devstack sudo[104257]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-28ab62c7-79e3-487e-b808-1ab2f5362165" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Lock "cinder-quobyte-28ab62c7-79e3-487e-b808-1ab2f5362165" released by "delete_volume" :: held 0.687s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Created reservations ['4c669e8c-2583-4530-8533-fad000a2ecd8', '55d17b9e-a04e-441d-8496-055ccb3d8a6b', 'a7a12ea1-5ddc-42f3-9fed-e4dc8ae2ad70', '4f03e18e-1c87-4e4b-936f-d813221f5125'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:48:50 devstack sudo[104260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:48:50 devstack sudo[104260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:48:50 devstack sudo[104260]: pam_unix(sudo:session): session closed for user root Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.272s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:48:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Deleted volume successfully. Sep 18 00:48:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-426d167b-763d-446c-b582-0db5762f764f tempest-VolumesListTestJSON-546782007 None] Lock "cinder-28ab62c7-79e3-487e-b808-1ab2f5362165-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:49:00 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=83,cinder:UPDATE=124,cinder:DELETE=6,cinder:INSERT=24 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:49:00 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=106,cinder:SELECT=91,cinder:INSERT=28,cinder:DELETE=13 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:04 devstack sudo[104267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:49:04 devstack sudo[104267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:04 devstack sudo[104267]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.308s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:49:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Flow 'volume_create_manager' (dedf6eb5-f6b4-4408-9bd9-412d9d1b5b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4d73b3-15cb-4f18-b0e1-6e3ab421c69a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf4d73b3-15cb-4f18-b0e1-6e3ab421c69a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-578147978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67729f9f-5547-4680-b014-d005d85477f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc63d8bfd74cdc86bf2c8b02788f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:49:23Z,use_quota=True,user_id='2e7ffc7e2cfa46ae9154c11599e98ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d987b0-552f-47f9-a325-c94a388c5368) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68d987b0-552f-47f9-a325-c94a388c5368) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cbde43-425e-4e85-bdcb-cee008b0d725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4cbde43-425e-4e85-bdcb-cee008b0d725) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67729f9f-5547-4680-b014-d005d85477f9', 'volume_name': 'volume-67729f9f-5547-4680-b014-d005d85477f9', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbdd322-3fa6-424e-9e27-bd8a45a00818) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bbdd322-3fa6-424e-9e27-bd8a45a00818) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39a0521-6222-4b60-b70d-6f2687786f75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Volume 67729f9f-5547-4680-b014-d005d85477f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67729f9f-5547-4680-b014-d005d85477f9', 'volume_size': 1} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:49:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-578147978',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67729f9f-5547-4680-b014-d005d85477f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1cfc63d8bfd74cdc86bf2c8b02788f1c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:49:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:49:23Z,use_quota=True,user_id='2e7ffc7e2cfa46ae9154c11599e98ccb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Creating volume 67729f9f-5547-4680-b014-d005d85477f9 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:49:22 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:49:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:22 devstack sudo[104404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 1073741824 Sep 18 00:49:22 devstack sudo[104404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:23 devstack sudo[104404]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 1073741824" returned: 0 in 0.560s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:23 devstack sudo[104411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 Sep 18 00:49:23 devstack sudo[104411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:23 devstack sudo[104411]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c39a0521-6222-4b60-b70d-6f2687786f75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67729f9f-5547-4680-b014-d005d85477f9', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19368997-4ebd-4bb4-be01-889ca84e7109) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Volume volume-67729f9f-5547-4680-b014-d005d85477f9 (67729f9f-5547-4680-b014-d005d85477f9): created successfully Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (19368997-4ebd-4bb4-be01-889ca84e7109) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Flow 'volume_create_manager' (dedf6eb5-f6b4-4408-9bd9-412d9d1b5b9c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:49:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1f167b9a-1847-4d8a-af89-7284a4f35f7a tempest-TestImageHashVerification-250354224 None] Created volume successfully. Sep 18 00:49:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[94c6b78e-eab6-4cd3-b977-cb808f5ef882]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:49:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:25 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 Sep 18 00:49:25 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:26 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9" returned: 0 in 0.363s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[20ee50be-10ce-4ca8-9e84-80901045bb2d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:49:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:26 devstack sudo[104421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 Sep 18 00:49:26 devstack sudo[104421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:26 devstack sudo[104421]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9" returned: 0 in 0.357s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 /opt/stack/data/cinder/conversion/67729f9f-5547-4680-b014-d005d85477f9.temp_image.b1bc5c3c-0d42-4b38-87fe-70b4d0de0fb8cpauodw3.img {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:26 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 /opt/stack/data/cinder/conversion/67729f9f-5547-4680-b014-d005d85477f9.temp_image.b1bc5c3c-0d42-4b38-87fe-70b4d0de0fb8cpauodw3.img Sep 18 00:49:26 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:33 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 /opt/stack/data/cinder/conversion/67729f9f-5547-4680-b014-d005d85477f9.temp_image.b1bc5c3c-0d42-4b38-87fe-70b4d0de0fb8cpauodw3.img" returned: 0 in 7.099s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:33 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[734ceca4-1584-4d01-8d78-67e7c16a6e47]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:49:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:33 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 Sep 18 00:49:33 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:33 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=3,cinder:SELECT=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:49:34 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9" returned: 0 in 0.551s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:34 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9, size 1024.00 MB, duration 7.10 sec, destination /opt/stack/data/cinder/conversion/67729f9f-5547-4680-b014-d005d85477f9.temp_image.b1bc5c3c-0d42-4b38-87fe-70b4d0de0fb8cpauodw3.img {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:49:34 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Converted 1024.00 MB image at 144.16 MB/s Sep 18 00:49:34 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] b1bc5c3c-0d42-4b38-87fe-70b4d0de0fb8 was raw, no need to convert to raw {{(pid=86526) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=6,cinder:UPDATE=3,cinder:INSERT=1,cinder:DELETE=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Flow 'volume_create_manager' (e5ad5e07-212e-4ffa-bb38-f3fa5129a1b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c5280c-98bb-43bd-9624-9854ef738f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97c5280c-98bb-43bd-9624-9854ef738f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1624846768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44550720-8722-49f2-b139-54138a724f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819d00d0b295413ebb37feed6baa11d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:49:45Z,use_quota=True,user_id='d8b6b3c587a4495ca6210fa4cb8a2758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2419c2d-5be5-4be5-b6e8-8c7d83336860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2419c2d-5be5-4be5-b6e8-8c7d83336860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ee300b-2661-4c09-8149-81485c74530e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44ee300b-2661-4c09-8149-81485c74530e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '44550720-8722-49f2-b139-54138a724f7f', 'volume_name': 'volume-44550720-8722-49f2-b139-54138a724f7f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc91707-6b3f-4dc1-95f1-ac045d1837ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dc91707-6b3f-4dc1-95f1-ac045d1837ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a0cc46-a7b8-49dd-9b7a-936b6f229f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:44 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Volume 44550720-8722-49f2-b139-54138a724f7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-44550720-8722-49f2-b139-54138a724f7f', 'volume_size': 1} Sep 18 00:49:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 27.322s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Uploaded volume to glance image-id: b1bc5c3c-0d42-4b38-87fe-70b4d0de0fb8. {{(pid=86526) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.129s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:49:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1624846768',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=44550720-8722-49f2-b139-54138a724f7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='819d00d0b295413ebb37feed6baa11d4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:49:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:49:45Z,use_quota=True,user_id='d8b6b3c587a4495ca6210fa4cb8a2758',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Creating volume 44550720-8722-49f2-b139-54138a724f7f {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:49:53 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:53 devstack sudo[104469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f 1073741824 Sep 18 00:49:53 devstack sudo[104469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8b2bf491-60ff-4dbc-9ad9-347f0ab5d9c9 tempest-TestImageHashVerification-250354224 None] Copy volume to image completed successfully. Sep 18 00:49:53 devstack sudo[104469]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f 1073741824" returned: 0 in 0.419s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:53 devstack sudo[104475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f Sep 18 00:49:53 devstack sudo[104475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:53 devstack sudo[104475]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b9a0cc46-a7b8-49dd-9b7a-936b6f229f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-44550720-8722-49f2-b139-54138a724f7f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba5c709-9fc2-46aa-9098-319d03c9e145) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:49:53 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Volume volume-44550720-8722-49f2-b139-54138a724f7f (44550720-8722-49f2-b139-54138a724f7f): created successfully Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9ba5c709-9fc2-46aa-9098-319d03c9e145) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:49:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Flow 'volume_create_manager' (e5ad5e07-212e-4ffa-bb38-f3fa5129a1b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:49:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6435ab9e-d4b3-433d-9245-6bd6d5e894c3 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Created volume successfully. Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Acquiring lock "cinder-67729f9f-5547-4680-b014-d005d85477f9-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Lock "cinder-67729f9f-5547-4680-b014-d005d85477f9-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Acquiring lock "cinder-quobyte-67729f9f-5547-4680-b014-d005d85477f9" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Lock "cinder-quobyte-67729f9f-5547-4680-b014-d005d85477f9" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1385b573-e2dd-4338-9b3c-f2a3504047d5]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:54 devstack sudo[104478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 Sep 18 00:49:54 devstack sudo[104478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:54 devstack sudo[104478]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9" returned: 0 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:54 devstack sudo[104486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9 Sep 18 00:49:54 devstack sudo[104486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:55 devstack sudo[104486]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-67729f9f-5547-4680-b014-d005d85477f9" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-221a207f-4e41-4ef1-bff9-157a75157231 req-c2f31dc0-6c65-4f3b-8952-8ce88bc08c5c tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-221a207f-4e41-4ef1-bff9-157a75157231 req-c2f31dc0-6c65-4f3b-8952-8ce88bc08c5c tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Lock "cinder-quobyte-67729f9f-5547-4680-b014-d005d85477f9" released by "delete_volume" :: held 0.733s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [req-221a207f-4e41-4ef1-bff9-157a75157231 req-c2f31dc0-6c65-4f3b-8952-8ce88bc08c5c tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-221a207f-4e41-4ef1-bff9-157a75157231 req-c2f31dc0-6c65-4f3b-8952-8ce88bc08c5c tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa', 'name': 'volume-44550720-8722-49f2-b139-54138a724f7f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1255fbe8-ea05-42a7-a6bc-a7e8c900dd77', 'enforce_multipath': True} {{(pid=86526) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Created reservations ['230bb12c-ad69-4169-9fa4-e1f907e0358e', '0e2dd47e-6fb2-46ae-a232-52c03a0cf291', '07446b06-3600-472b-879f-b83628197e26', '5429aea2-ed0f-45e8-bc03-c1e665f788a7'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:49:55 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-221a207f-4e41-4ef1-bff9-157a75157231 req-c2f31dc0-6c65-4f3b-8952-8ce88bc08c5c tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] attachment_update completed successfully. Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:55 devstack sudo[104497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:49:55 devstack sudo[104497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:55 devstack sudo[104497]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.289s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:49:55 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Deleted volume successfully. Sep 18 00:49:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9a7fb3f9-525e-43d9-9397-015fb384c1b4 tempest-TestImageHashVerification-250354224 None] Lock "cinder-67729f9f-5547-4680-b014-d005d85477f9-delete_volume" released by "delete_volume" :: held 1.264s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:49:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [req-278230a8-cef3-47b6-958a-2bb5dee2f19b req-fe5fe748-94b4-45c8-bcb1-bf581f06b233 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Terminate volume connection completed successfully. Sep 18 00:49:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [req-278230a8-cef3-47b6-958a-2bb5dee2f19b req-fe5fe748-94b4-45c8-bcb1-bf581f06b233 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Deleting attachment 1255fbe8-ea05-42a7-a6bc-a7e8c900dd77. {{(pid=86526) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Acquiring lock "cinder-44550720-8722-49f2-b139-54138a724f7f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "cinder-44550720-8722-49f2-b139-54138a724f7f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Acquiring lock "cinder-quobyte-44550720-8722-49f2-b139-54138a724f7f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "cinder-quobyte-44550720-8722-49f2-b139-54138a724f7f" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[df236b5a-774d-4a13-b5a6-934e4cb05a87]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:59 devstack sudo[104948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f Sep 18 00:49:59 devstack sudo[104948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:59 devstack sudo[104948]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f" returned: 0 in 0.388s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:59 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f Sep 18 00:49:59 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:49:59 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-44550720-8722-49f2-b139-54138a724f7f" returned: 0 in 0.279s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "cinder-quobyte-44550720-8722-49f2-b139-54138a724f7f" released by "delete_volume" :: held 0.717s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Created reservations ['e30d834e-d5af-4461-85a4-ed9259915866', 'c632591f-fd0b-4981-8c7a-fd263c634359', 'a7245f17-b05a-42b3-a1c2-a5c25a740737', '06e69f1e-feda-4234-9a22-a3342ecb4723'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:49:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:49:59 devstack sudo[104957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:49:59 devstack sudo[104957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:00 devstack sudo[104957]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:00 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Deleted volume successfully. Sep 18 00:50:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-39142f84-7606-4b01-bdfa-735f1eb2a1a2 tempest-TestServerVolumeAttachScenarioOldVersion-695777341 None] Lock "cinder-44550720-8722-49f2-b139-54138a724f7f-delete_volume" released by "delete_volume" :: held 1.218s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:04 devstack sudo[104987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:04 devstack sudo[104987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:04 devstack sudo[104987]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:50:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (80581328-dd14-4503-9553-f2fa3582a401) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7caf02d-113a-4a0d-a1e4-a7e8ccb07682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7caf02d-113a-4a0d-a1e4-a7e8ccb07682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147948192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d3ee4b-5ede-4c61-851a-1edcd68077d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:08Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965c0fce-e6b5-4283-96d2-a1c0c75f0b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (965c0fce-e6b5-4283-96d2-a1c0c75f0b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a508e167-0c53-4deb-b2f7-06e692c7b469) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a508e167-0c53-4deb-b2f7-06e692c7b469) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '84d3ee4b-5ede-4c61-851a-1edcd68077d8', 'volume_name': 'volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33291977-e3b1-4c1b-ac7e-57545672d606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33291977-e3b1-4c1b-ac7e-57545672d606) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbee2060-2777-4381-a463-252eca5e26ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:08 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume 84d3ee4b-5ede-4c61-851a-1edcd68077d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8', 'volume_size': 1} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1147948192',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=84d3ee4b-5ede-4c61-851a-1edcd68077d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:08Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Creating volume 84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:08 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:08 devstack sudo[105029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 1073741824 Sep 18 00:50:08 devstack sudo[105029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:08 devstack sudo[105029]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 1073741824" returned: 0 in 0.450s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:08 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 Sep 18 00:50:08 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:09 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] <== create_volume: return (792ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbee2060-2777-4381-a463-252eca5e26ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c994377-71c6-495e-9df7-4fa4035f9103) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:09 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 (84d3ee4b-5ede-4c61-851a-1edcd68077d8): created successfully Sep 18 00:50:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8c994377-71c6-495e-9df7-4fa4035f9103) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (80581328-dd14-4503-9553-f2fa3582a401) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:09 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-31d04fe0-ebe2-469a-9965-884e1e231f09 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created volume successfully. Sep 18 00:50:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Creating offline snapshot 70f8aecf-7ca2-45cc-9689-ba55635d5558 of volume 84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:50:10 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6553f837-29a7-4786-bc45-ee7137940d5a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:10 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 Sep 18 00:50:10 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:10 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8" returned: 0 in 0.383s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:11 devstack sudo[105046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 1G Sep 18 00:50:11 devstack sudo[105046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:11 devstack sudo[105046]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 1G" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:11 devstack sudo[105053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 Sep 18 00:50:11 devstack sudo[105053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:11 devstack sudo[105053]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558" returned: 0 in 0.306s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:11 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 is being set with open permissions: ugo+rw Sep 18 00:50:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:11 devstack sudo[105058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 Sep 18 00:50:11 devstack sudo[105058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:11 devstack sudo[105058]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558" returned: 0 in 0.255s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:12 devstack sudo[105061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.info Sep 18 00:50:12 devstack sudo[105061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:12 devstack sudo[105061]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.info" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:12 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.info is being set with open permissions: ugo+rw Sep 18 00:50:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:12 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.info Sep 18 00:50:12 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:12 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.info" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d631b814-7232-4bb1-9958-cc3db2d113a8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Create snapshot completed successfully Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (58cc64d3-6072-422d-bef6-aadee19f8a31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04be7cc-003b-4177-8028-40b59840f317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04be7cc-003b-4177-8028-40b59840f317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022439401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670fa6c6-251c-42c8-944d-4905536954a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:14Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c04586-3324-463f-b424-4b5fb218339f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2c04586-3324-463f-b424-4b5fb218339f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48324d7-a2b0-4b84-a86b-cd1c285e59b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c48324d7-a2b0-4b84-a86b-cd1c285e59b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '670fa6c6-251c-42c8-944d-4905536954a7', 'volume_name': 'volume-670fa6c6-251c-42c8-944d-4905536954a7', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff02bb8-9aa1-4df1-a691-77fce353a49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ff02bb8-9aa1-4df1-a691-77fce353a49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d02983-e6a4-42c6-add2-6c7180661a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume 670fa6c6-251c-42c8-944d-4905536954a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-670fa6c6-251c-42c8-944d-4905536954a7', 'volume_size': 1} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1022439401',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=670fa6c6-251c-42c8-944d-4905536954a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:14Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Creating volume 670fa6c6-251c-42c8-944d-4905536954a7 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:14 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:14 devstack sudo[105074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 1073741824 Sep 18 00:50:14 devstack sudo[105074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (3cab801e-b8fa-42d9-9279-17c8244215b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f887d6-51e9-43c3-8172-fc95b62e4a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05f887d6-51e9-43c3-8172-fc95b62e4a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486268893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad7cc10-b874-4748-bb16-5f2ec22acb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:15Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3a87b6-37e5-40b4-b6fb-5b4db42e3d96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3a87b6-37e5-40b4-b6fb-5b4db42e3d96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a87326-2ccb-423c-96f2-7079b28744fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (03a87326-2ccb-423c-96f2-7079b28744fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bad7cc10-b874-4748-bb16-5f2ec22acb9c', 'volume_name': 'volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd6af55-cd04-4272-abae-21edae3be4e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bd6af55-cd04-4272-abae-21edae3be4e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ec15da-3ddf-4fe5-b991-1c31b88b2d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume bad7cc10-b874-4748-bb16-5f2ec22acb9c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c', 'volume_size': 1} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:14 devstack sudo[105074]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 1073741824" returned: 0 in 0.576s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:15 devstack sudo[105080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 Sep 18 00:50:15 devstack sudo[105080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (e8610649-0f54-41be-b04b-c57bae03c220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4d34fe-9b20-4111-be3a-ce19f66132a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b4d34fe-9b20-4111-be3a-ce19f66132a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1289891241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57381704-f3de-43e0-b682-88513abb5fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:15Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15c3d4c-2c04-4c35-a1b7-d7fcc890297f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f15c3d4c-2c04-4c35-a1b7-d7fcc890297f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eccaa0-573c-481f-91ff-a14cc64f0bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2eccaa0-573c-481f-91ff-a14cc64f0bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57381704-f3de-43e0-b682-88513abb5fad', 'volume_name': 'volume-57381704-f3de-43e0-b682-88513abb5fad', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e9b66e-dad1-4fe1-a269-d922c3d58cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50e9b66e-dad1-4fe1-a269-d922c3d58cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a81fdb0-6721-4637-b455-890d659adcd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume 57381704-f3de-43e0-b682-88513abb5fad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57381704-f3de-43e0-b682-88513abb5fad', 'volume_size': 1} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:15 devstack sudo[105080]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] <== create_volume: return (974ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.976s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.513s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1486268893',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bad7cc10-b874-4748-bb16-5f2ec22acb9c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:15Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Creating volume bad7cc10-b874-4748-bb16-5f2ec22acb9c {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:15 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (32d02983-e6a4-42c6-add2-6c7180661a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-670fa6c6-251c-42c8-944d-4905536954a7', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack sudo[105083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c 1073741824 Sep 18 00:50:15 devstack sudo[105083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d98b5f6-68a7-4a64-94a1-6222745ebc77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume volume-670fa6c6-251c-42c8-944d-4905536954a7 (670fa6c6-251c-42c8-944d-4905536954a7): created successfully Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d98b5f6-68a7-4a64-94a1-6222745ebc77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (58cc64d3-6072-422d-bef6-aadee19f8a31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f3ae994e-242b-49b5-b987-fa9b5ffc7bc7 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created volume successfully. Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (07498ac2-3f78-4e51-b926-023f406638d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e72789-b30b-4076-bdce-4fae385dab90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52e72789-b30b-4076-bdce-4fae385dab90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1897013275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e593fe-da22-416a-b8bc-f80449842d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:16Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c03886-41dd-44b2-a97c-250bf4118055) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4c03886-41dd-44b2-a97c-250bf4118055) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be73ee7-2649-470b-b7ed-62ba7fc7e5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8be73ee7-2649-470b-b7ed-62ba7fc7e5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a5e593fe-da22-416a-b8bc-f80449842d15', 'volume_name': 'volume-a5e593fe-da22-416a-b8bc-f80449842d15', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80f4617-5927-4041-94f6-596040ca8fa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f80f4617-5927-4041-94f6-596040ca8fa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e19e6b8-bd11-4f77-9e5f-0287963a9b97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume a5e593fe-da22-416a-b8bc-f80449842d15: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a5e593fe-da22-416a-b8bc-f80449842d15', 'volume_size': 1} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:15 devstack sudo[105083]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c 1073741824" returned: 0 in 0.571s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:15 devstack sudo[105090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c Sep 18 00:50:15 devstack sudo[105090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (9efcb577-1e5e-4197-93fd-fc8863122e65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4102ea43-cdc0-4a45-80ae-ededd5502ee5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4102ea43-cdc0-4a45-80ae-ededd5502ee5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62071788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec3fbfc-1a73-43af-b33e-d287ebf1d136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:16Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8ccf13-72f6-461d-815c-1dd7a5703650) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ec8ccf13-72f6-461d-815c-1dd7a5703650) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f775110-39a3-43e1-b472-b460e4527ca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f775110-39a3-43e1-b472-b460e4527ca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bec3fbfc-1a73-43af-b33e-d287ebf1d136', 'volume_name': 'volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14716993-a505-427e-9210-da7aabaf7e18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14716993-a505-427e-9210-da7aabaf7e18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c762db7-fafe-4ac8-931f-f222be29bee1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume bec3fbfc-1a73-43af-b33e-d287ebf1d136: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136', 'volume_size': 1} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:16 devstack sudo[105090]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1289891241',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57381704-f3de-43e0-b682-88513abb5fad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:15Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Creating volume 57381704-f3de-43e0-b682-88513abb5fad {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:16 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0ec15da-3ddf-4fe5-b991-1c31b88b2d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d61691-a40b-4c3f-8baf-d0917ec82d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:16 devstack sudo[105093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad 1073741824 Sep 18 00:50:16 devstack sudo[105093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c (bad7cc10-b874-4748-bb16-5f2ec22acb9c): created successfully Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38d61691-a40b-4c3f-8baf-d0917ec82d5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (3cab801e-b8fa-42d9-9279-17c8244215b7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6ef45ef5-4045-4eb6-aeed-c59a14fb48dd tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created volume successfully. Sep 18 00:50:16 devstack sudo[105093]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad 1073741824" returned: 0 in 0.448s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:16 devstack sudo[105098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad Sep 18 00:50:16 devstack sudo[105098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:16 devstack sudo[105098]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] <== create_volume: return (761ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.307s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1897013275',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a5e593fe-da22-416a-b8bc-f80449842d15,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:16Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Creating volume a5e593fe-da22-416a-b8bc-f80449842d15 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:16 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9a81fdb0-6721-4637-b455-890d659adcd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57381704-f3de-43e0-b682-88513abb5fad', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd0dc9c-c058-4ac1-a3c8-4faf2a922a9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack sudo[105101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 1073741824 Sep 18 00:50:17 devstack sudo[105101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume volume-57381704-f3de-43e0-b682-88513abb5fad (57381704-f3de-43e0-b682-88513abb5fad): created successfully Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ecd0dc9c-c058-4ac1-a3c8-4faf2a922a9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (e8610649-0f54-41be-b04b-c57bae03c220) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (e322982e-6c91-4143-8bdf-312944dbdfdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be9e255-beef-4187-b30d-50c0fc393fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-77b796b4-7cab-4604-bcbd-57340148dadb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created volume successfully. Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6be9e255-beef-4187-b30d-50c0fc393fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981098107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e983a-a281-4846-b712-24ec68e4c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:17Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fa1233-8bb2-4996-9a77-2f447b721a7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34fa1233-8bb2-4996-9a77-2f447b721a7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a57b144-7ff0-4fde-8aa7-9552d1d703a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a57b144-7ff0-4fde-8aa7-9552d1d703a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a2e983a-a281-4846-b712-24ec68e4c417', 'volume_name': 'volume-5a2e983a-a281-4846-b712-24ec68e4c417', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c69c0b-b1c7-46d3-b1b2-af4b1fabc9bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43c69c0b-b1c7-46d3-b1b2-af4b1fabc9bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d34c1e-ad6e-4d5d-af10-df49f5c57058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Volume 5a2e983a-a281-4846-b712-24ec68e4c417: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a2e983a-a281-4846-b712-24ec68e4c417', 'volume_size': 1} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (2f006626-a402-447f-96e5-51d1e1886604) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0199ab41-43a5-47b6-a1bb-96afe8994189) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0199ab41-43a5-47b6-a1bb-96afe8994189) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024646546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b953f92d-07e5-4cf4-8a56-455592e2a009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:17Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaa050a-c2b4-45aa-ab00-f30f1fc5423e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7aaa050a-c2b4-45aa-ab00-f30f1fc5423e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c732f23-2f3b-48e0-b9c2-c2a024df6353) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c732f23-2f3b-48e0-b9c2-c2a024df6353) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b953f92d-07e5-4cf4-8a56-455592e2a009', 'volume_name': 'volume-b953f92d-07e5-4cf4-8a56-455592e2a009', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975632e0-d2c3-4f6b-9f77-b5ad40ef2e7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (975632e0-d2c3-4f6b-9f77-b5ad40ef2e7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack sudo[105101]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3780f8-8bd8-4ea4-b663-dc2c48d6a201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Volume b953f92d-07e5-4cf4-8a56-455592e2a009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b953f92d-07e5-4cf4-8a56-455592e2a009', 'volume_size': 1} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 1073741824" returned: 0 in 0.571s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:17 devstack sudo[105107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 Sep 18 00:50:17 devstack sudo[105107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:17 devstack sudo[105107]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (e33682a3-73fc-4bd9-8ffd-1af2650d162c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81e1522-486e-4cd4-9d92-29ac201429e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15" returned: 0 in 0.299s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.797s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-62071788',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bec3fbfc-1a73-43af-b33e-d287ebf1d136,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cd7c1a62f99e4d99903114d4fe743c01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:16Z,use_quota=True,user_id='4e1a61d1a232410a9a52dce9eac4bb72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Creating volume bec3fbfc-1a73-43af-b33e-d287ebf1d136 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:17 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:17 devstack sudo[105110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 1073741824 Sep 18 00:50:17 devstack sudo[105110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a81e1522-486e-4cd4-9d92-29ac201429e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-292527864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb43273-5020-467f-a28d-22a888415906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:18Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cfb6b3-8ea2-46b4-842a-29ab51db2506) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19cfb6b3-8ea2-46b4-842a-29ab51db2506) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8ed154-c0c0-48c8-9059-5068a6777cbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d8ed154-c0c0-48c8-9059-5068a6777cbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbb43273-5020-467f-a28d-22a888415906', 'volume_name': 'volume-fbb43273-5020-467f-a28d-22a888415906', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6506494-5207-43cd-a658-e85cae42e9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d6506494-5207-43cd-a658-e85cae42e9b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47fde2d-8d4c-436b-8a6d-c8723b84ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Volume fbb43273-5020-467f-a28d-22a888415906: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbb43273-5020-467f-a28d-22a888415906', 'volume_size': 1} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e19e6b8-bd11-4f77-9e5f-0287963a9b97) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a5e593fe-da22-416a-b8bc-f80449842d15', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7093c1-3365-4d85-adae-177278201fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume volume-a5e593fe-da22-416a-b8bc-f80449842d15 (a5e593fe-da22-416a-b8bc-f80449842d15): created successfully Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb7093c1-3365-4d85-adae-177278201fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (07498ac2-3f78-4e51-b926-023f406638d8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-273ce3dd-7b08-45d2-94c2-bad92b2747f1 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created volume successfully. Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (2789ef46-32f5-4e71-be13-0f2414654c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c8498-3a22-4e02-8a23-6bc4f06485bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d2c8498-3a22-4e02-8a23-6bc4f06485bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401059897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5d977c-91a8-4143-b82c-047895966100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:18Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5a8256-060f-49ea-bc6f-18c1d40112c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c5a8256-060f-49ea-bc6f-18c1d40112c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae875283-8cf0-43fe-b74e-45526db381b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ae875283-8cf0-43fe-b74e-45526db381b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed5d977c-91a8-4143-b82c-047895966100', 'volume_name': 'volume-ed5d977c-91a8-4143-b82c-047895966100', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47275aa0-a16f-47c2-91ff-a373ef7f796c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47275aa0-a16f-47c2-91ff-a373ef7f796c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3ee1dd-a659-4a52-b1e4-a44fb0728daf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Volume ed5d977c-91a8-4143-b82c-047895966100: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed5d977c-91a8-4143-b82c-047895966100', 'volume_size': 1} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:18 devstack sudo[105110]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 1073741824" returned: 0 in 0.512s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:18 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 Sep 18 00:50:18 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (375ec2c1-a754-4c94-924b-116bd9c94389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52655a66-5923-4fb2-bc51-1da7f527cb93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52655a66-5923-4fb2-bc51-1da7f527cb93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331483782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0faf24e2-1c11-4274-94f1-ba21cb441465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:19Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce0cee-a11e-4071-aa3b-b686ad645876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1ce0cee-a11e-4071-aa3b-b686ad645876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d513c68-5958-463f-b689-b4cfa7498260) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5d513c68-5958-463f-b689-b4cfa7498260) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0faf24e2-1c11-4274-94f1-ba21cb441465', 'volume_name': 'volume-0faf24e2-1c11-4274-94f1-ba21cb441465', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168cc7f5-f07e-436f-8fc0-68f4b80c4001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (168cc7f5-f07e-436f-8fc0-68f4b80c4001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc8a8b6-9a46-4e6f-8ba6-3a46946808a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Volume 0faf24e2-1c11-4274-94f1-ba21cb441465: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0faf24e2-1c11-4274-94f1-ba21cb441465', 'volume_size': 1} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:18 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.478s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-981098107',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a2e983a-a281-4846-b712-24ec68e4c417,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:17Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Creating volume 5a2e983a-a281-4846-b712-24ec68e4c417 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:18 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c762db7-fafe-4ac8-931f-f222be29bee1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74183586-380c-4798-8943-89116e3b5e97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:18 devstack sudo[105119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 1073741824 Sep 18 00:50:18 devstack sudo[105119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Volume volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 (bec3fbfc-1a73-43af-b33e-d287ebf1d136): created successfully Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74183586-380c-4798-8943-89116e3b5e97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Flow 'volume_create_manager' (9efcb577-1e5e-4197-93fd-fc8863122e65) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c34a123e-3650-4bad-ada0-c1af755d6969 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created volume successfully. Sep 18 00:50:19 devstack sudo[105119]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 1073741824" returned: 0 in 0.409s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:19 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 Sep 18 00:50:19 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-bec3fbfc-1a73-43af-b33e-d287ebf1d136-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:19 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] <== create_volume: return (706ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-bec3fbfc-1a73-43af-b33e-d287ebf1d136-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.871s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1024646546',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b953f92d-07e5-4cf4-8a56-455592e2a009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:17Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Creating volume b953f92d-07e5-4cf4-8a56-455592e2a009 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:19 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25d34c1e-ad6e-4d5d-af10-df49f5c57058) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a2e983a-a281-4846-b712-24ec68e4c417', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:19 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 1073741824 Sep 18 00:50:19 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdfdb93-8e4c-4e15-9219-ab4b870e92ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Volume volume-5a2e983a-a281-4846-b712-24ec68e4c417 (5a2e983a-a281-4846-b712-24ec68e4c417): created successfully Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ffdfdb93-8e4c-4e15-9219-ab4b870e92ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (e322982e-6c91-4143-8bdf-312944dbdfdf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e6c45ce0-8756-40a8-b9bc-be004cb0ee43 tempest-CreateVolumesFromImageTest-1789623871 None] Created volume successfully. Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-bec3fbfc-1a73-43af-b33e-d287ebf1d136" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-bec3fbfc-1a73-43af-b33e-d287ebf1d136" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[71b9c5c1-6179-4dc8-99e0-2372ade42bd3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:19 devstack sudo[105129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 Sep 18 00:50:19 devstack sudo[105129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:19 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 1073741824" returned: 0 in 0.439s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:19 devstack sudo[105136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 Sep 18 00:50:19 devstack sudo[105136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:19 devstack sudo[105129]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136" returned: 0 in 0.410s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:20 devstack sudo[105139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136 Sep 18 00:50:20 devstack sudo[105139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:20 devstack sudo[105136]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.191s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-292527864',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbb43273-5020-467f-a28d-22a888415906,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:18Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Creating volume fbb43273-5020-467f-a28d-22a888415906 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:20 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0b3780f8-8bd8-4ea4-b663-dc2c48d6a201) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b953f92d-07e5-4cf4-8a56-455592e2a009', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994fff5d-7b79-456f-9ff4-5e437b64d0db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:20 devstack sudo[105142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 1073741824 Sep 18 00:50:20 devstack sudo[105142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Volume volume-b953f92d-07e5-4cf4-8a56-455592e2a009 (b953f92d-07e5-4cf4-8a56-455592e2a009): created successfully Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (994fff5d-7b79-456f-9ff4-5e437b64d0db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (2f006626-a402-447f-96e5-51d1e1886604) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c3561857-767b-4830-8d47-d2ddd5dddb62 tempest-CreateVolumesFromImageTest-1789623871 None] Created volume successfully. Sep 18 00:50:20 devstack sudo[105139]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bec3fbfc-1a73-43af-b33e-d287ebf1d136" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-bec3fbfc-1a73-43af-b33e-d287ebf1d136" released by "delete_volume" :: held 0.732s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created reservations ['8ed3c16a-32e8-42db-9bd9-6bc3167374dd', '76ef0fe5-92b3-4d1b-9832-dbc798733165', '80a7d9e1-0970-4467-9416-424ac2079f24', '408b0aa6-39d0-4954-8d88-48de621efc08'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:20 devstack sudo[105145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:20 devstack sudo[105145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-a5e593fe-da22-416a-b8bc-f80449842d15-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-a5e593fe-da22-416a-b8bc-f80449842d15-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-a5e593fe-da22-416a-b8bc-f80449842d15" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-a5e593fe-da22-416a-b8bc-f80449842d15" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:20 devstack sudo[105145]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:20 devstack sudo[105142]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.320s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 1073741824" returned: 0 in 0.529s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Deleted volume successfully. Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c862bba0-ce6e-4e6e-b96d-94d27c60885e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-67b7dfe2-a7eb-495e-ae79-466eb39c8dce tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-bec3fbfc-1a73-43af-b33e-d287ebf1d136-delete_volume" released by "delete_volume" :: held 1.331s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:20 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 Sep 18 00:50:20 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:20 devstack sudo[105152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 Sep 18 00:50:20 devstack sudo[105152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:21 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] <== create_volume: return (861ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.865s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.674s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1401059897',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed5d977c-91a8-4143-b82c-047895966100,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:18Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Creating volume ed5d977c-91a8-4143-b82c-047895966100 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:21 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c47fde2d-8d4c-436b-8a6d-c8723b84ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbb43273-5020-467f-a28d-22a888415906', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:21 devstack sudo[105160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 1073741824 Sep 18 00:50:21 devstack sudo[105160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f36a7a-b9bf-4ad5-9201-12c6aebbbdce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Volume volume-fbb43273-5020-467f-a28d-22a888415906 (fbb43273-5020-467f-a28d-22a888415906): created successfully Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79f36a7a-b9bf-4ad5-9201-12c6aebbbdce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (e33682a3-73fc-4bd9-8ffd-1af2650d162c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:21 devstack sudo[105152]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-41efb49e-d54e-4457-8311-9453843aaed6 tempest-CreateVolumesFromImageTest-1789623871 None] Created volume successfully. Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15" returned: 0 in 0.390s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:21 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15 Sep 18 00:50:21 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:21 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a5e593fe-da22-416a-b8bc-f80449842d15" returned: 0 in 0.294s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-a5e593fe-da22-416a-b8bc-f80449842d15" released by "delete_volume" :: held 0.763s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:21 devstack sudo[105160]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 1073741824" returned: 0 in 0.423s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created reservations ['6fa942b9-be02-40b4-b637-8c1a0000c984', '5e29f15f-d838-40bd-abbe-7a2aa6ba1108', 'df7a26c7-7fc9-4d6a-aaa9-0dde8ad44570', 'af00004b-7627-409b-b49e-14c593caeaf9'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:21 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 Sep 18 00:50:21 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:21 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:21 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:21 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100" returned: 0 in 0.270s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] <== create_volume: return (738ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.742s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.132s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1331483782',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0faf24e2-1c11-4274-94f1-ba21cb441465,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4806ca07d849447a9f4ee2199c6ddc42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:19Z,use_quota=True,user_id='27357426e2ac40a5ab8d227be5fc7e1e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Creating volume 0faf24e2-1c11-4274-94f1-ba21cb441465 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:21 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-57381704-f3de-43e0-b682-88513abb5fad-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:21 devstack sudo[105176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 1073741824 Sep 18 00:50:21 devstack sudo[105176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f3ee1dd-a659-4a52-b1e4-a44fb0728daf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed5d977c-91a8-4143-b82c-047895966100', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c173bb6b-b2e8-4514-9f7b-9d3425f9d9e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-57381704-f3de-43e0-b682-88513abb5fad-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:21 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.315s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Volume volume-ed5d977c-91a8-4143-b82c-047895966100 (ed5d977c-91a8-4143-b82c-047895966100): created successfully Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c173bb6b-b2e8-4514-9f7b-9d3425f9d9e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (2789ef46-32f5-4e71-be13-0f2414654c48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Deleted volume successfully. Sep 18 00:50:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2d3cc52d-3235-437b-94e8-e58d3d3c9054 tempest-CreateVolumesFromImageTest-1789623871 None] Created volume successfully. Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-92de2d21-9636-45d9-9df3-ded0878c60e8 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-a5e593fe-da22-416a-b8bc-f80449842d15-delete_volume" released by "delete_volume" :: held 1.330s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-57381704-f3de-43e0-b682-88513abb5fad" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-57381704-f3de-43e0-b682-88513abb5fad" acquired by "delete_volume" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b67637fa-4a2e-482b-a10e-b7c3e48fbe43]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:22 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad Sep 18 00:50:22 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:22 devstack sudo[105176]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 1073741824" returned: 0 in 0.483s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:22 devstack sudo[105185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 Sep 18 00:50:22 devstack sudo[105185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:22 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad" returned: 0 in 0.395s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:22 devstack sudo[105188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad Sep 18 00:50:22 devstack sudo[105188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:22 devstack sudo[105185]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cc8a8b6-9a46-4e6f-8ba6-3a46946808a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0faf24e2-1c11-4274-94f1-ba21cb441465', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb598889-4d54-4ef7-9554-d2b4d76254b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Volume volume-0faf24e2-1c11-4274-94f1-ba21cb441465 (0faf24e2-1c11-4274-94f1-ba21cb441465): created successfully Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb598889-4d54-4ef7-9554-d2b4d76254b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Flow 'volume_create_manager' (375ec2c1-a754-4c94-924b-116bd9c94389) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:22 devstack sudo[105188]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-57381704-f3de-43e0-b682-88513abb5fad" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-866bdcfd-b4e4-4142-be46-147ddbc8ec76 tempest-CreateVolumesFromImageTest-1789623871 None] Created volume successfully. Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-57381704-f3de-43e0-b682-88513abb5fad" released by "delete_volume" :: held 0.694s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created reservations ['72888332-6647-4342-acb6-4bb9ef2812b1', '679e33b2-f1d7-4847-bb54-a3e06266a6e7', '66c75547-cbf4-483d-a530-c1afd58d4322', 'bcbf676a-c620-49bd-b848-c9e8b7c42340'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:22 devstack sudo[105192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:22 devstack sudo[105192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-bad7cc10-b874-4748-bb16-5f2ec22acb9c-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-bad7cc10-b874-4748-bb16-5f2ec22acb9c-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:23 devstack sudo[105192]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-bad7cc10-b874-4748-bb16-5f2ec22acb9c" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.294s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Deleted volume successfully. Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-bad7cc10-b874-4748-bb16-5f2ec22acb9c" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-29db5481-a9eb-476f-aa2d-1db8f68f8b0c tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-57381704-f3de-43e0-b682-88513abb5fad-delete_volume" released by "delete_volume" :: held 1.263s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8fe1bb-3c07-46ce-bc42-a31c2d3128a4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-0faf24e2-1c11-4274-94f1-ba21cb441465-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-0faf24e2-1c11-4274-94f1-ba21cb441465-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-quobyte-0faf24e2-1c11-4274-94f1-ba21cb441465" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-0faf24e2-1c11-4274-94f1-ba21cb441465" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:23 devstack sudo[105195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c Sep 18 00:50:23 devstack sudo[105195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f50190-c160-4bf7-8d68-88916269819b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:23 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 Sep 18 00:50:23 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:23 devstack sudo[105195]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:23 devstack sudo[105202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c Sep 18 00:50:23 devstack sudo[105202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:23 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465" returned: 0 in 0.388s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:23 devstack sudo[105207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465 Sep 18 00:50:23 devstack sudo[105207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:23 devstack sudo[105202]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bad7cc10-b874-4748-bb16-5f2ec22acb9c" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-bad7cc10-b874-4748-bb16-5f2ec22acb9c" released by "delete_volume" :: held 0.720s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created reservations ['4f0e9b9e-18d4-440b-a2b1-99c895932096', '074e5f20-d138-4136-8b50-efbc1709f71f', 'f3e85328-4903-4566-b92c-9cb43a27cfb5', '9b08731c-2e27-4038-aa57-8cdbab614e2d'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:23 devstack sudo[105207]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0faf24e2-1c11-4274-94f1-ba21cb441465" returned: 0 in 0.247s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-0faf24e2-1c11-4274-94f1-ba21cb441465" released by "delete_volume" :: held 0.706s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:23 devstack sudo[105211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:23 devstack sudo[105211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Created reservations ['6ce10a5f-a6e9-4500-b2cd-6dc3e3e1928f', '66e667f1-3d66-40ab-8460-1593ead49a13', 'f6e8d21f-bce7-48ed-9bcb-d99af0515ea9', '8f615aa3-aec3-4552-882a-3ee97b090d78'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:24 devstack sudo[105213]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:24 devstack sudo[105213]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-670fa6c6-251c-42c8-944d-4905536954a7-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:24 devstack sudo[105211]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-670fa6c6-251c-42c8-944d-4905536954a7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.280s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Deleted volume successfully. Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bb432e-e6b3-48ec-9aba-4d39c8446af5 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-bad7cc10-b874-4748-bb16-5f2ec22acb9c-delete_volume" released by "delete_volume" :: held 1.258s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-670fa6c6-251c-42c8-944d-4905536954a7" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-670fa6c6-251c-42c8-944d-4905536954a7" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b0718e54-666d-4aad-84b1-63e61a30303c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:24 devstack sudo[105213]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Deleted volume successfully. Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-ed5d977c-91a8-4143-b82c-047895966100-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0336d519-c9c9-4d3f-9545-b4e23ab0bcd5 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-0faf24e2-1c11-4274-94f1-ba21cb441465-delete_volume" released by "delete_volume" :: held 1.203s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-ed5d977c-91a8-4143-b82c-047895966100-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-quobyte-ed5d977c-91a8-4143-b82c-047895966100" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-ed5d977c-91a8-4143-b82c-047895966100" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:24 devstack sudo[105217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 Sep 18 00:50:24 devstack sudo[105217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8adf409-6a41-4db9-9732-68f1407a28bb]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:24 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 Sep 18 00:50:24 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:24 devstack sudo[105217]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7" returned: 0 in 0.389s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:24 devstack sudo[105224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7 Sep 18 00:50:24 devstack sudo[105224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:24 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100" returned: 0 in 0.387s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:24 devstack sudo[105229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100 Sep 18 00:50:24 devstack sudo[105229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:24 devstack sudo[105224]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-670fa6c6-251c-42c8-944d-4905536954a7" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-670fa6c6-251c-42c8-944d-4905536954a7" released by "delete_volume" :: held 0.695s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created reservations ['516d99d6-92d3-4eb7-b8eb-e8abcffac207', '1019ec9d-0e0f-43f2-b3a0-ba380fe595a7', '84f7c79f-bc2e-4cca-86d2-3badaef90c71', 'dba72f52-3463-43ad-941b-f05f2941da7e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:25 devstack sudo[105229]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ed5d977c-91a8-4143-b82c-047895966100" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:25 devstack sudo[105233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:25 devstack sudo[105233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-ed5d977c-91a8-4143-b82c-047895966100" released by "delete_volume" :: held 0.696s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Created reservations ['19f316eb-bed7-4214-ab5a-bd5545a061cd', '95b04b07-6908-4a59-be45-c6d69df13042', 'd1bee486-e200-4b5f-8ff8-fe2c68145100', '3b059c25-c4a2-4e3c-801a-8972fd1dfe13'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:25 devstack sudo[105235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:25 devstack sudo[105235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:25 devstack sudo[105233]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-70f8aecf-7ca2-45cc-9689-ba55635d5558-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Deleted volume successfully. Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-70f8aecf-7ca2-45cc-9689-ba55635d5558-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-84d3ee4b-5ede-4c61-851a-1edcd68077d8" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7e1950c3-d6f9-4ef9-8bdd-32cc3973f6eb tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-670fa6c6-251c-42c8-944d-4905536954a7-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-84d3ee4b-5ede-4c61-851a-1edcd68077d8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-70f8aecf-7ca2-45cc-9689-ba55635d5558" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-70f8aecf-7ca2-45cc-9689-ba55635d5558" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Deleting offline snapshot 70f8aecf-7ca2-45cc-9689-ba55635d5558 of volume 84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] snapshot_file for this snap is: volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcbd6617-d721-42d6-836d-5441d72db221]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-fbb43273-5020-467f-a28d-22a888415906-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-fbb43273-5020-467f-a28d-22a888415906-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:25 devstack sudo[105235]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.304s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Deleted volume successfully. Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e53a620f-de07-4452-9ddc-079e2d4776da tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-ed5d977c-91a8-4143-b82c-047895966100-delete_volume" released by "delete_volume" :: held 1.214s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-quobyte-fbb43273-5020-467f-a28d-22a888415906" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-fbb43273-5020-467f-a28d-22a888415906" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:25 devstack sudo[105238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 Sep 18 00:50:25 devstack sudo[105238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8919c7aa-61e3-44f1-a4bc-d92ac286e91c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:25 devstack sudo[105241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 Sep 18 00:50:25 devstack sudo[105241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:25 devstack sudo[105238]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[23106f20-76ba-45fe-8941-64dbae017806]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:26 devstack sudo[105241]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906" returned: 0 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:26 devstack sudo[105246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 Sep 18 00:50:26 devstack sudo[105246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:26 devstack sudo[105250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906 Sep 18 00:50:26 devstack sudo[105250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:26 devstack sudo[105250]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-fbb43273-5020-467f-a28d-22a888415906" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:26 devstack sudo[105246]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8" returned: 0 in 0.373s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-fbb43273-5020-467f-a28d-22a888415906" released by "delete_volume" :: held 0.679s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:26 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 Sep 18 00:50:26 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Created reservations ['99341bc2-94c8-4228-b0ef-6d7198edfdcc', '24b2aa9c-ac08-4dd1-b9d7-1911fe5fb2ed', '0052a4e5-6c20-4123-addc-1f2a7db256de', '3013d8ad-dde9-4577-8979-9c722c447c02'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:26 devstack sudo[105259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:26 devstack sudo[105259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:26 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558" returned: 0 in 0.337s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:26 devstack sudo[105264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558 Sep 18 00:50:26 devstack sudo[105264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:26 devstack sudo[105259]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:26 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Deleted volume successfully. Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-b953f92d-07e5-4cf4-8a56-455592e2a009-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-b953f92d-07e5-4cf4-8a56-455592e2a009-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a773eda0-72b3-4fe3-9c0c-9eb93c5f0ece tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-fbb43273-5020-467f-a28d-22a888415906-delete_volume" released by "delete_volume" :: held 1.195s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-quobyte-b953f92d-07e5-4cf4-8a56-455592e2a009" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-b953f92d-07e5-4cf4-8a56-455592e2a009" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d71bb0d-8f25-4612-8458-70f3c23db26b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:26 devstack sudo[105264]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8.70f8aecf-7ca2-45cc-9689-ba55635d5558" returned: 0 in 0.294s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:26 devstack sudo[105267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 Sep 18 00:50:26 devstack sudo[105267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-70f8aecf-7ca2-45cc-9689-ba55635d5558" released by "_delete_snapshot" :: held 1.532s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:26 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-84d3ee4b-5ede-4c61-851a-1edcd68077d8" released by "delete_snapshot" :: held 1.559s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created reservations ['b51510c5-07bd-4aa0-a1b8-f0233e88577a', '11759582-ad31-41d6-8fd4-2c50c06b2a5b', 'abe40aee-7567-40d0-ad9d-d8414b8423a6', '239242d1-7c9a-4e75-8e42-883eff05204e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Delete snapshot completed successfully. Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ce70f0ea-b1a0-4e09-b162-ab71fe982806 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-70f8aecf-7ca2-45cc-9689-ba55635d5558-delete_snapshot" released by "delete_snapshot" :: held 1.699s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:27 devstack sudo[105267]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009" returned: 0 in 0.368s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:27 devstack sudo[105273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009 Sep 18 00:50:27 devstack sudo[105273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:27 devstack sudo[105273]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b953f92d-07e5-4cf4-8a56-455592e2a009" returned: 0 in 0.242s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-b953f92d-07e5-4cf4-8a56-455592e2a009" released by "delete_volume" :: held 0.649s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Created reservations ['5888a722-b5f8-4320-9dd8-4c7dbd8e2f22', '533940e8-c82f-4495-9070-62c4a30f8da5', '1afd0192-da66-4afa-b750-3a0b4f266f83', '8b798fda-05f3-4bf0-ae52-9b999c9ccf36'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-84d3ee4b-5ede-4c61-851a-1edcd68077d8-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-84d3ee4b-5ede-4c61-851a-1edcd68077d8-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "cinder-quobyte-84d3ee4b-5ede-4c61-851a-1edcd68077d8" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:27 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:27 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-84d3ee4b-5ede-4c61-851a-1edcd68077d8" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0dcd5fe2-02df-41dd-acb5-dd4e48854265]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:27 devstack sudo[105278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 Sep 18 00:50:27 devstack sudo[105278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:27 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Deleted volume successfully. Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3651a7a2-7377-4b1b-aa03-703da1f1a598 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-b953f92d-07e5-4cf4-8a56-455592e2a009-delete_volume" released by "delete_volume" :: held 1.157s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-5a2e983a-a281-4846-b712-24ec68e4c417-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-5a2e983a-a281-4846-b712-24ec68e4c417-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:27 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "cinder-quobyte-5a2e983a-a281-4846-b712-24ec68e4c417" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-5a2e983a-a281-4846-b712-24ec68e4c417" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[377171f4-e676-4e6d-ad6f-a62d1519e0c2]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:28 devstack sudo[105278]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8" returned: 0 in 0.385s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:28 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8 Sep 18 00:50:28 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:28 devstack sudo[105284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 Sep 18 00:50:28 devstack sudo[105284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:28 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-84d3ee4b-5ede-4c61-851a-1edcd68077d8" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-quobyte-84d3ee4b-5ede-4c61-851a-1edcd68077d8" released by "delete_volume" :: held 0.704s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Created reservations ['7aa962ae-9d4e-4e72-b80b-0510233a8930', '578cf576-796d-419b-8597-291abddf2002', 'b53ea595-227b-4800-ac6d-7cf24e0fe4cc', '110aaba6-cebd-4275-bb60-0c4cbde143ac'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:28 devstack sudo[105284]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:28 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417 Sep 18 00:50:28 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:28 devstack sudo[105294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:28 devstack sudo[105294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:28 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-5a2e983a-a281-4846-b712-24ec68e4c417" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-quobyte-5a2e983a-a281-4846-b712-24ec68e4c417" released by "delete_volume" :: held 0.692s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:28 devstack sudo[105294]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Created reservations ['9be1afc1-2ae1-4365-b949-49a9ecb52122', '35031f0b-a0b5-4c81-9496-a4406ec5b927', '57ee3844-5e26-4238-9082-7e7d3e63a2d4', '37c678b2-c9e7-4456-83c7-483aef5e43e3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.274s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Deleted volume successfully. Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-85748959-f03b-4e78-bfe2-bec4934bfdf4 tempest-CreateVolumesFromSnapshotTest-1883100716 None] Lock "cinder-84d3ee4b-5ede-4c61-851a-1edcd68077d8-delete_volume" released by "delete_volume" :: held 1.242s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:28 devstack sudo[105298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:28 devstack sudo[105298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:29 devstack sudo[105298]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:29 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Deleted volume successfully. Sep 18 00:50:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fcc107c3-79d7-41ea-bf4e-644c34ab6c72 tempest-CreateVolumesFromImageTest-1789623871 None] Lock "cinder-5a2e983a-a281-4846-b712-24ec68e4c417-delete_volume" released by "delete_volume" :: held 1.202s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (01f4b6e4-2c28-4e5b-bed2-b6b0a372401f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10656bc7-083f-4558-9ac8-355bf934141b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10656bc7-083f-4558-9ac8-355bf934141b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1896871390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0a380e-a037-4370-97a1-0f7eccad4d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:32Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b7e1ec-ffac-4851-8125-dffe361b0bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2b7e1ec-ffac-4851-8125-dffe361b0bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c61f434-5092-43fb-a95c-38dcbf49ba48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c61f434-5092-43fb-a95c-38dcbf49ba48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca0a380e-a037-4370-97a1-0f7eccad4d5e', 'volume_name': 'volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f89bf6e-072a-477b-8995-62502673827c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f89bf6e-072a-477b-8995-62502673827c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b24def-2c16-47a1-bf0c-02f70c5b77ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume ca0a380e-a037-4370-97a1-0f7eccad4d5e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e', 'volume_size': 1} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1896871390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca0a380e-a037-4370-97a1-0f7eccad4d5e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:32Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Creating volume ca0a380e-a037-4370-97a1-0f7eccad4d5e {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:32 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:32 devstack sudo[105302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e 1073741824 Sep 18 00:50:32 devstack sudo[105302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:32 devstack sudo[105302]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e 1073741824" returned: 0 in 0.439s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:32 devstack sudo[105308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e Sep 18 00:50:32 devstack sudo[105308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:32 devstack sudo[105308]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] <== create_volume: return (735ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0b24def-2c16-47a1-bf0c-02f70c5b77ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f0c2bd-09fd-4469-8ca5-e4b720ab2fed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e (ca0a380e-a037-4370-97a1-0f7eccad4d5e): created successfully Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02f0c2bd-09fd-4469-8ca5-e4b720ab2fed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (01f4b6e4-2c28-4e5b-bed2-b6b0a372401f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3acf75a6-2c70-439e-92fb-62d676270329 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created volume successfully. Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (5fb6fd1b-393c-46d4-b000-7687d8cc86be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940fbccb-801d-4d37-b9c7-7563a6353e83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (940fbccb-801d-4d37-b9c7-7563a6353e83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775628054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd6e7cd-173f-4406-8211-9e97f0ace244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:34Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05be067-1e09-40f1-b05f-c837d65096be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b05be067-1e09-40f1-b05f-c837d65096be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83672f45-9e1d-4e17-b8ed-3521ce5aba75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (83672f45-9e1d-4e17-b8ed-3521ce5aba75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dfd6e7cd-173f-4406-8211-9e97f0ace244', 'volume_name': 'volume-dfd6e7cd-173f-4406-8211-9e97f0ace244', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00c6a68-bf18-4d2c-bed9-c39b553cb77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c00c6a68-bf18-4d2c-bed9-c39b553cb77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d3a9d-475d-4fbf-872a-8356fefa92c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume dfd6e7cd-173f-4406-8211-9e97f0ace244: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dfd6e7cd-173f-4406-8211-9e97f0ace244', 'volume_size': 1} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-775628054',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dfd6e7cd-173f-4406-8211-9e97f0ace244,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:34Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Creating volume dfd6e7cd-173f-4406-8211-9e97f0ace244 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:33 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:33 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 1073741824 Sep 18 00:50:33 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (3dd26f24-ae09-4c88-be73-62414c442317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde15998-dda3-41dc-b6ff-94d6c867341c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bde15998-dda3-41dc-b6ff-94d6c867341c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479178781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c78543-8d7a-4259-8bdc-fc1134f4b6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:34Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88950c29-3fcc-432c-82b5-7a67c6151570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88950c29-3fcc-432c-82b5-7a67c6151570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b5c804-4aea-41d9-89c6-ea3ad8bb2b2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8b5c804-4aea-41d9-89c6-ea3ad8bb2b2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06c78543-8d7a-4259-8bdc-fc1134f4b6b1', 'volume_name': 'volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b08b2f-bc81-4b62-a7f2-f8c1d7676dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (32b08b2f-bc81-4b62-a7f2-f8c1d7676dea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d25c41-6556-4638-95b6-af8e720a5b7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume 06c78543-8d7a-4259-8bdc-fc1134f4b6b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1', 'volume_size': 1} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:34 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 1073741824" returned: 0 in 0.618s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:34 devstack sudo[105318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 Sep 18 00:50:34 devstack sudo[105318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:34 devstack sudo[105318]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244" returned: 0 in 0.332s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.611s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1479178781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06c78543-8d7a-4259-8bdc-fc1134f4b6b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:34Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Creating volume 06c78543-8d7a-4259-8bdc-fc1134f4b6b1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:34 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:34 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 1073741824 Sep 18 00:50:34 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Flow 'volume_create_manager' (f9dcf1ea-a080-4326-aaa4-ddcbfd4378c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19f931-3ad5-41ee-81e0-b1d0174c8d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (153d3a9d-475d-4fbf-872a-8356fefa92c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dfd6e7cd-173f-4406-8211-9e97f0ace244', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9291be61-746e-4f00-87ea-a047ac66d4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (b18f2119-504a-4fae-98b6-41fe486e17f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a135f70f-81e6-4346-9b00-cf8bd0cc831c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 (dfd6e7cd-173f-4406-8211-9e97f0ace244): created successfully Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9291be61-746e-4f00-87ea-a047ac66d4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (5fb6fd1b-393c-46d4-b000-7687d8cc86be) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ef19f931-3ad5-41ee-81e0-b1d0174c8d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f10bcca-f7df-43ee-8276-04a542745725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253ba42c2e84703bbc8afc5ccf6cf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='9313786fbdca47818b73138f81f44dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a84f0d6-9454-469e-8071-a02c0a83f1c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a84f0d6-9454-469e-8071-a02c0a83f1c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32de9c2e-d197-45b0-bb6f-0473ac855b8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a135f70f-81e6-4346-9b00-cf8bd0cc831c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052251784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5b57bb-221d-43a9-b4da-1da23b780e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ffeb96-da61-4b0b-b46e-f19d88ab4fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (79ffeb96-da61-4b0b-b46e-f19d88ab4fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b88a037-9f45-4b16-8d3b-77c487c1130a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8b88a037-9f45-4b16-8d3b-77c487c1130a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a5b57bb-221d-43a9-b4da-1da23b780e0d', 'volume_name': 'volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f33b92a-fc26-4e20-900d-0ebf142e9e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2f33b92a-fc26-4e20-900d-0ebf142e9e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8708e387-4216-47b2-8e9c-572c008efa53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume 7a5b57bb-221d-43a9-b4da-1da23b780e0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d', 'volume_size': 1} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d10a07d2-d086-4b88-bc31-30b5fb9617b5 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created volume successfully. Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (21f78515-a9f3-44d7-a70b-bea24962f057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fceb6384-5f19-46bb-9afd-c6cc07fb2acb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fceb6384-5f19-46bb-9afd-c6cc07fb2acb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-499527930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64663f98-4690-4ca8-831b-82e06147a3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b918d5c-6aca-443b-a940-c684a8ea59f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b918d5c-6aca-443b-a940-c684a8ea59f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c1524f-d75b-47ea-a67b-7237777976c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52c1524f-d75b-47ea-a67b-7237777976c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '64663f98-4690-4ca8-831b-82e06147a3d7', 'volume_name': 'volume-64663f98-4690-4ca8-831b-82e06147a3d7', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bee8c1-f450-4f97-a22f-46c905d91884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bee8c1-f450-4f97-a22f-46c905d91884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd7b06c-eed4-40bc-b4a7-52ba7f1c9faf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume 64663f98-4690-4ca8-831b-82e06147a3d7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-64663f98-4690-4ca8-831b-82e06147a3d7', 'volume_size': 1} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (219baacb-ca07-47ac-a621-abbbea7224ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1620f3af-d137-47de-adbb-f34161edf904) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1620f3af-d137-47de-adbb-f34161edf904) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000399711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fc6342-0190-48e6-8c30-f19b4c9761bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0319153-0693-48ae-a503-5aee98758f05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e0319153-0693-48ae-a503-5aee98758f05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46b106e-c854-4c46-a919-5dd8fe93da82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b46b106e-c854-4c46-a919-5dd8fe93da82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b4fc6342-0190-48e6-8c30-f19b4c9761bb', 'volume_name': 'volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd43925e-2cc5-4f29-b235-9979dedd9b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fd43925e-2cc5-4f29-b235-9979dedd9b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bb1348-fe30-4ae5-b021-6c00e60b72b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume b4fc6342-0190-48e6-8c30-f19b4c9761bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb', 'volume_size': 1} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:35 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 1073741824" returned: 0 in 0.626s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:35 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 Sep 18 00:50:35 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32de9c2e-d197-45b0-bb6f-0473ac855b8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4f10bcca-f7df-43ee-8276-04a542745725', 'volume_name': 'volume-4f10bcca-f7df-43ee-8276-04a542745725', 'volume_size': 1, 'image_id': '14311d9c-89c9-48e1-9112-cad8f2c3b611', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14311d9c-89c9-48e1-9112-cad8f2c3b611', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2219ea793b503e716656c9498cf01c58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b253ba42c2e84703bbc8afc5ccf6cf04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15facab09509d772ce6a40a8b2a38f851248714f203922447f5f1ec25d58654d1674caa9c4893a6579bac5cc96e8f23ad639b8631e2299d3e1fde6a5b9e1371c', 'id': '14311d9c-89c9-48e1-9112-cad8f2c3b611', 'created_at': datetime.datetime(2026, 9, 17, 22, 50, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 50, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14311d9c-89c9-48e1-9112-cad8f2c3b611/file', 'properties': {}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fdc4b2-61c0-4b50-8b85-66a75175fc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58fdc4b2-61c0-4b50-8b85-66a75175fc81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e425e1dc-0212-4771-86b4-9f431595e184) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Volume 4f10bcca-f7df-43ee-8276-04a542745725: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4f10bcca-f7df-43ee-8276-04a542745725', 'volume_size': 1, 'image_id': '14311d9c-89c9-48e1-9112-cad8f2c3b611', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14311d9c-89c9-48e1-9112-cad8f2c3b611', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2219ea793b503e716656c9498cf01c58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b253ba42c2e84703bbc8afc5ccf6cf04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15facab09509d772ce6a40a8b2a38f851248714f203922447f5f1ec25d58654d1674caa9c4893a6579bac5cc96e8f23ad639b8631e2299d3e1fde6a5b9e1371c', 'id': '14311d9c-89c9-48e1-9112-cad8f2c3b611', 'created_at': datetime.datetime(2026, 9, 17, 22, 50, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 50, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14311d9c-89c9-48e1-9112-cad8f2c3b611/file', 'properties': {}}, 'image_service': } Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Trying to clone 4f10bcca-f7df-43ee-8276-04a542745725 from image 14311d9c-89c9-48e1-9112-cad8f2c3b611 at location (None, [{'url': 'file:///opt/stack/data/glance/images/14311d9c-89c9-48e1-9112-cad8f2c3b611', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Image download 0.00 MB at 0.00 MB/s Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e020bc27-f6c5-4e28-b08c-583e58278866]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:35 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] <== create_volume: return (926ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.929s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.587s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1052251784',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a5b57bb-221d-43a9-b4da-1da23b780e0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Creating volume 7a5b57bb-221d-43a9-b4da-1da23b780e0d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a8d25c41-6556-4638-95b6-af8e720a5b7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d 1073741824 Sep 18 00:50:35 devstack sudo[105330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a390795-e190-4d2b-bd87-69c0a335178e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:35 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:35 devstack sudo[105330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 (06c78543-8d7a-4259-8bdc-fc1134f4b6b1): created successfully Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a390795-e190-4d2b-bd87-69c0a335178e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (3dd26f24-ae09-4c88-be73-62414c442317) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-210ba79f-a84a-4523-8b63-25e7fa737fd4 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created volume successfully. Sep 18 00:50:35 devstack sudo[105330]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD" returned: 0 in 0.349s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:36 devstack sudo[105340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD Sep 18 00:50:36 devstack sudo[105340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:36 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d 1073741824" returned: 0 in 0.455s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:36 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d Sep 18 00:50:36 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:36 devstack sudo[105340]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD" returned: 1 in 0.349s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Temporary image 14311d9c-89c9-48e1-9112-cad8f2c3b611 is fetched for user 9313786fbdca47818b73138f81f44dd5. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[95d8b525-c7d2-4ba0-8ef9-0b90387e01d1]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:36 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d" returned: 0 in 0.278s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] <== create_volume: return (778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.234s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-499527930',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=64663f98-4690-4ca8-831b-82e06147a3d7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Creating volume 64663f98-4690-4ca8-831b-82e06147a3d7 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:36 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8708e387-4216-47b2-8e9c-572c008efa53) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b61df96-1e24-4be8-b040-0eea1a11d551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:36 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 1073741824 Sep 18 00:50:36 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:36 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d (7a5b57bb-221d-43a9-b4da-1da23b780e0d): created successfully Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1b61df96-1e24-4be8-b040-0eea1a11d551) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:36 devstack sudo[105350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD Sep 18 00:50:36 devstack sudo[105350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (b18f2119-504a-4fae-98b6-41fe486e17f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-19f0d488-c751-4368-935e-505929e8e4c7 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created volume successfully. Sep 18 00:50:36 devstack sudo[105350]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:36 devstack sudo[105359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD Sep 18 00:50:36 devstack sudo[105359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:36 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 1073741824" returned: 0 in 0.418s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:36 devstack sudo[105362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 Sep 18 00:50:36 devstack sudo[105362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:37 devstack sudo[105359]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:37 devstack sudo[105362]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7" returned: 0 in 0.244s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.710s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.817s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2000399711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b4fc6342-0190-48e6-8c30-f19b4c9761bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7077b055bed540b9872cddbb96ba71ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='856e29a105344e84be5f9d51df3755fd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Creating volume b4fc6342-0190-48e6-8c30-f19b4c9761bb {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:37 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cfd7b06c-eed4-40bc-b4a7-52ba7f1c9faf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-64663f98-4690-4ca8-831b-82e06147a3d7', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:37 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb 1073741824 Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101506d-54fe-4f1c-b511-877638b6e522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:37 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume volume-64663f98-4690-4ca8-831b-82e06147a3d7 (64663f98-4690-4ca8-831b-82e06147a3d7): created successfully Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c101506d-54fe-4f1c-b511-877638b6e522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (21f78515-a9f3-44d7-a70b-bea24962f057) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4e970ee8-59e4-4ae3-83f4-afcded9aa373 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created volume successfully. Sep 18 00:50:37 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb 1073741824" returned: 0 in 0.459s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:37 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb Sep 18 00:50:37 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:37 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb" returned: 0 in 0.245s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] <== create_volume: return (742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.745s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.831s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f10bcca-f7df-43ee-8276-04a542745725,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b253ba42c2e84703bbc8afc5ccf6cf04',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:35Z,use_quota=True,user_id='9313786fbdca47818b73138f81f44dd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Creating volume 4f10bcca-f7df-43ee-8276-04a542745725 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:37 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3bb1348-fe30-4ae5-b021-6c00e60b72b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfc117c-33a5-414c-9181-52c6e97a3835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:37 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 1073741824 Sep 18 00:50:37 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Volume volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb (b4fc6342-0190-48e6-8c30-f19b4c9761bb): created successfully Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ccfc117c-33a5-414c-9181-52c6e97a3835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Flow 'volume_create_manager' (219baacb-ca07-47ac-a621-abbbea7224ad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ec0d79a3-623c-45d9-8d2d-8fa291e1ff4a tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created volume successfully. Sep 18 00:50:38 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 1073741824" returned: 0 in 0.414s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:38 devstack sudo[105382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 Sep 18 00:50:38 devstack sudo[105382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:38 devstack sudo[105382]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] <== create_volume: return (702ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.706s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Attempting download of 14311d9c-89c9-48e1-9112-cad8f2c3b611 ((None, [{'url': 'file:///opt/stack/data/glance/images/14311d9c-89c9-48e1-9112-cad8f2c3b611', 'metadata': {}}])) to volume 4f10bcca-f7df-43ee-8276-04a542745725. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-b4fc6342-0190-48e6-8c30-f19b4c9761bb-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-b4fc6342-0190-48e6-8c30-f19b4c9761bb-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8784ec2-47cf-45de-b059-dd8ef866c70f]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14311d9c-89c9-48e1-9112-cad8f2c3b611_3vu94xl2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-quobyte-b4fc6342-0190-48e6-8c30-f19b4c9761bb" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-b4fc6342-0190-48e6-8c30-f19b4c9761bb" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7822fcb3-2587-415b-a542-dc2f2bbd6040]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:38 devstack sudo[105387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14311d9c-89c9-48e1-9112-cad8f2c3b611_3vu94xl2 Sep 18 00:50:38 devstack sudo[105387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:38 devstack sudo[105388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb Sep 18 00:50:38 devstack sudo[105388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:38 devstack sudo[105387]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_14311d9c-89c9-48e1-9112-cad8f2c3b611_3vu94xl2" returned: 0 in 0.329s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14311d9c-89c9-48e1-9112-cad8f2c3b611_3vu94xl2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:39 devstack sudo[105388]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb" returned: 0 in 0.365s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:39 devstack sudo[105393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14311d9c-89c9-48e1-9112-cad8f2c3b611_3vu94xl2 Sep 18 00:50:39 devstack sudo[105393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:39 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb Sep 18 00:50:39 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:39 devstack sudo[105393]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14311d9c-89c9-48e1-9112-cad8f2c3b611_3vu94xl2" returned: 1 in 0.343s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_14311d9c-89c9-48e1-9112-cad8f2c3b611_3vu94xl2' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[25429f26-6602-4212-97aa-2fc67d756143]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:39 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b4fc6342-0190-48e6-8c30-f19b4c9761bb" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-b4fc6342-0190-48e6-8c30-f19b4c9761bb" released by "delete_volume" :: held 0.671s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created reservations ['52cfc2d0-caf7-4157-a184-a3b0528a05e5', 'fe498296-cb6e-4793-bcd5-d24a60f7e0fe', '120ff22b-53a4-49ad-9a34-0524cd58fa24', '024a607d-04c2-45f7-8d63-2ca116ada53b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:39 devstack sudo[105403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD Sep 18 00:50:39 devstack sudo[105403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:39 devstack sudo[105405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:39 devstack sudo[105405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:39 devstack sudo[105403]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD" returned: 0 in 0.348s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:39 devstack sudo[105405]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Deleted volume successfully. Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-09f848ad-6a1e-4d63-a3aa-0692398eee80 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-b4fc6342-0190-48e6-8c30-f19b4c9761bb-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-64663f98-4690-4ca8-831b-82e06147a3d7-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:39 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD Sep 18 00:50:39 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-64663f98-4690-4ca8-831b-82e06147a3d7-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-quobyte-64663f98-4690-4ca8-831b-82e06147a3d7" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-64663f98-4690-4ca8-831b-82e06147a3d7" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[be78bf63-cda6-4f31-9a76-c58a3f8a6f42]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:40 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 Sep 18 00:50:40 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:40 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD" returned: 1 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] 14311d9c-89c9-48e1-9112-cad8f2c3b611 was raw, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:40 devstack sudo[105417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 Sep 18 00:50:40 devstack sudo[105417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:40 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7" returned: 0 in 0.363s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:40 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7 Sep 18 00:50:40 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:40 devstack sudo[105417]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:40 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725" returned: 0 in 0.495s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_14311d9c-89c9-48e1-9112-cad8f2c3b611_nym06xgkdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:50:40 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-64663f98-4690-4ca8-831b-82e06147a3d7" returned: 0 in 0.307s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-64663f98-4690-4ca8-831b-82e06147a3d7" released by "delete_volume" :: held 0.719s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:40 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 1G Sep 18 00:50:40 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created reservations ['36839d8a-ddec-4c10-af21-d6af8fbe07fb', 'dc99e02f-ed52-4a72-894e-87c88481f55f', '91fc416d-02ff-429d-a972-380aded27819', 'a9b763f6-695a-4ec0-bfd4-bbe5da6c263a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:40 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:40 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:40 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 1G" returned: 0 in 0.372s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Downloaded image 14311d9c-89c9-48e1-9112-cad8f2c3b611 ((None, [{'url': 'file:///opt/stack/data/glance/images/14311d9c-89c9-48e1-9112-cad8f2c3b611', 'metadata': {}}])) to volume 4f10bcca-f7df-43ee-8276-04a542745725 successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Temporary image 14311d9c-89c9-48e1-9112-cad8f2c3b611 for user 9313786fbdca47818b73138f81f44dd5 is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Marking volume 4f10bcca-f7df-43ee-8276-04a542745725 as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Copying metadata from image 14311d9c-89c9-48e1-9112-cad8f2c3b611 to 4f10bcca-f7df-43ee-8276-04a542745725. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Creating volume glance metadata for volume 4f10bcca-f7df-43ee-8276-04a542745725 backed by image 14311d9c-89c9-48e1-9112-cad8f2c3b611 with: {'image_id': '14311d9c-89c9-48e1-9112-cad8f2c3b611', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '2219ea793b503e716656c9498cf01c58', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:50:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-7a5b57bb-221d-43a9-b4da-1da23b780e0d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:41 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.285s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-7a5b57bb-221d-43a9-b4da-1da23b780e0d-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Deleted volume successfully. Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e51b448-ce65-454c-a2b3-440d8b868b88 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-64663f98-4690-4ca8-831b-82e06147a3d7-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-quobyte-7a5b57bb-221d-43a9-b4da-1da23b780e0d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e425e1dc-0212-4771-86b4-9f431595e184) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f10bcca-f7df-43ee-8276-04a542745725', 'volume_size': 1, 'image_id': '14311d9c-89c9-48e1-9112-cad8f2c3b611', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/14311d9c-89c9-48e1-9112-cad8f2c3b611', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '2219ea793b503e716656c9498cf01c58', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b253ba42c2e84703bbc8afc5ccf6cf04', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '15facab09509d772ce6a40a8b2a38f851248714f203922447f5f1ec25d58654d1674caa9c4893a6579bac5cc96e8f23ad639b8631e2299d3e1fde6a5b9e1371c', 'id': '14311d9c-89c9-48e1-9112-cad8f2c3b611', 'created_at': datetime.datetime(2026, 9, 17, 22, 50, 32, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 50, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/14311d9c-89c9-48e1-9112-cad8f2c3b611/file', 'properties': {}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4daa9d5-76cd-4ca2-8d72-792085af72ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-7a5b57bb-221d-43a9-b4da-1da23b780e0d" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:41 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Volume volume-4f10bcca-f7df-43ee-8276-04a542745725 (4f10bcca-f7df-43ee-8276-04a542745725): created successfully Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4daa9d5-76cd-4ca2-8d72-792085af72ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Flow 'volume_create_manager' (f9dcf1ea-a080-4326-aaa4-ddcbfd4378c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d5887f7-ebee-4bae-8bfe-2e08f02f8f42]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1a5ea65c-ada2-435e-986a-c3e8a5e621c5 tempest-VolumeImageDependencyTests-1390459176 None] Created volume successfully. Sep 18 00:50:41 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d Sep 18 00:50:41 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:41 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d" returned: 0 in 0.359s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:41 devstack sudo[105443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d Sep 18 00:50:41 devstack sudo[105443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:41 devstack sudo[105443]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7a5b57bb-221d-43a9-b4da-1da23b780e0d" returned: 0 in 0.244s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-7a5b57bb-221d-43a9-b4da-1da23b780e0d" released by "delete_volume" :: held 0.659s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created reservations ['d2db2acc-807e-453b-b8f8-00f08ef69233', 'e6e66ba3-89f2-4ab7-bd92-0878c9a7551f', '498e174a-f326-4a0b-accf-3817e6a64d28', '5c61f814-c444-4577-ad83-cba3862baf70'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Acquiring lock "cinder-4f10bcca-f7df-43ee-8276-04a542745725-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Lock "cinder-4f10bcca-f7df-43ee-8276-04a542745725-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Acquiring lock "cinder-quobyte-4f10bcca-f7df-43ee-8276-04a542745725" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Lock "cinder-quobyte-4f10bcca-f7df-43ee-8276-04a542745725" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[025f1c08-f492-42d8-b526-43d4f00f17d3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:41 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:41 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:42 devstack sudo[105447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 Sep 18 00:50:42 devstack sudo[105447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-06c78543-8d7a-4259-8bdc-fc1134f4b6b1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-06c78543-8d7a-4259-8bdc-fc1134f4b6b1-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-quobyte-06c78543-8d7a-4259-8bdc-fc1134f4b6b1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:42 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-06c78543-8d7a-4259-8bdc-fc1134f4b6b1" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Deleted volume successfully. Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0cd5d8d-641f-42e2-a6e5-360c55a85668]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4fee80ec-5586-490e-a3a8-0c4282564c9c tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-7a5b57bb-221d-43a9-b4da-1da23b780e0d-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:42 devstack sudo[105447]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725" returned: 0 in 0.426s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:42 devstack sudo[105451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 Sep 18 00:50:42 devstack sudo[105451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:42 devstack sudo[105455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725 Sep 18 00:50:42 devstack sudo[105455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:42 devstack sudo[105455]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-4f10bcca-f7df-43ee-8276-04a542745725" returned: 0 in 0.246s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Lock "cinder-quobyte-4f10bcca-f7df-43ee-8276-04a542745725" released by "delete_volume" :: held 0.726s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:42 devstack sudo[105451]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1" returned: 0 in 0.387s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:42 devstack sudo[105462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1 Sep 18 00:50:42 devstack sudo[105462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Created reservations ['94ad6f1b-f5e7-44d9-a91a-bae03f74245d', 'd5b78488-8e26-4982-8528-a41d15e242f1', '2aea07d6-8a62-4978-812b-e9756917ee4c', '4ca145ad-f52f-4fa8-ae82-f6898a2222f3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:42 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:42 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:42 devstack sudo[105462]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06c78543-8d7a-4259-8bdc-fc1134f4b6b1" returned: 0 in 0.253s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-06c78543-8d7a-4259-8bdc-fc1134f4b6b1" released by "delete_volume" :: held 0.698s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created reservations ['10b08949-8869-4133-853b-a316e2195608', '2afff13b-64c5-4944-b054-a6da16eb289a', '788dc5ce-c07d-4a73-916d-a6b71d92b640', '5c22eef0-5fa1-46f7-bf17-fe47857f7067'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:43 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.277s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Deleted volume successfully. Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9043b45d-9f08-4bed-8aa9-e6ebb319ad05 tempest-VolumeImageDependencyTests-1390459176 None] Lock "cinder-4f10bcca-f7df-43ee-8276-04a542745725-delete_volume" released by "delete_volume" :: held 1.274s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:43 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:43 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:43 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Deleted volume successfully. Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-dfd6e7cd-173f-4406-8211-9e97f0ace244-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a0b9dc-0bb9-4413-8593-b74530d8645d tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-06c78543-8d7a-4259-8bdc-fc1134f4b6b1-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-dfd6e7cd-173f-4406-8211-9e97f0ace244-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-quobyte-dfd6e7cd-173f-4406-8211-9e97f0ace244" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-dfd6e7cd-173f-4406-8211-9e97f0ace244" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1bdc9a9-57ad-466d-970d-62117fe2c0bf]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:43 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 Sep 18 00:50:43 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:43 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244" returned: 0 in 0.375s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:43 devstack sudo[105476]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244 Sep 18 00:50:43 devstack sudo[105476]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:44 devstack sudo[105476]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-dfd6e7cd-173f-4406-8211-9e97f0ace244" returned: 0 in 0.278s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-dfd6e7cd-173f-4406-8211-9e97f0ace244" released by "delete_volume" :: held 0.707s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=221,cinder:SELECT=163,cinder:INSERT=43,cinder:DELETE=14 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=143,cinder:UPDATE=204,cinder:DELETE=24,cinder:INSERT=62 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created reservations ['15aff396-68f9-421b-8127-869afd01dbea', 'c90f7837-25de-449a-acbc-2f6b225f99f0', 'e5f1ba7f-a328-44ca-9fc8-6e032fec3b96', 'becff302-66e7-4704-afc4-a04c44f3b03f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:44 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:44 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-ca0a380e-a037-4370-97a1-0f7eccad4d5e-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:44 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Deleted volume successfully. Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-ca0a380e-a037-4370-97a1-0f7eccad4d5e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ea4d193f-ac8d-4d3b-8556-44bd5fd17aaf tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-dfd6e7cd-173f-4406-8211-9e97f0ace244-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "cinder-quobyte-ca0a380e-a037-4370-97a1-0f7eccad4d5e" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-ca0a380e-a037-4370-97a1-0f7eccad4d5e" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5d646df-39ca-4a26-b3cd-6f5bc372bc38]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:44 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e Sep 18 00:50:44 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:45 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e" returned: 0 in 0.377s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:45 devstack sudo[105487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e Sep 18 00:50:45 devstack sudo[105487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:45 devstack sudo[105487]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-ca0a380e-a037-4370-97a1-0f7eccad4d5e" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-quobyte-ca0a380e-a037-4370-97a1-0f7eccad4d5e" released by "delete_volume" :: held 0.683s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Created reservations ['c6cc33bd-cbfa-4b8f-bb50-1a7c1246fc6e', 'd7f23cc7-b2d3-4152-9319-9113409c31d1', '118b2f40-e4c4-4f94-84d4-9dd0337e5310', '7c201c5a-7984-4aa9-a90c-dcd0d07cd6a7'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:45 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:45 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:45 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Deleted volume successfully. Sep 18 00:50:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d9eddaa8-cf70-4985-a892-09d48a94bd03 tempest-CreateVolumesFromSourceVolumeTest-373678325 None] Lock "cinder-ca0a380e-a037-4370-97a1-0f7eccad4d5e-delete_volume" released by "delete_volume" :: held 1.151s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Flow 'volume_create_manager' (815d70f7-d2ce-4165-bb51-1e3315723dea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a75ccc-0adb-42a6-9aa6-7ae87c4d2217) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60a75ccc-0adb-42a6-9aa6-7ae87c4d2217) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374202f6-395d-4da4-b129-5bfd5c5c89b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06553e0ca8fb4a48a25247abdd6a916b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:49Z,use_quota=True,user_id='75917411344a4fe380034bb95e289064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bbe568-a8f9-415c-a6ad-05819a32faaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43bbe568-a8f9-415c-a6ad-05819a32faaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ba08cf-9b92-4e51-a048-52962dabf708) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11ba08cf-9b92-4e51-a048-52962dabf708) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '374202f6-395d-4da4-b129-5bfd5c5c89b3', 'volume_name': 'volume-374202f6-395d-4da4-b129-5bfd5c5c89b3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eca775-6681-491e-8d13-58fa2a639378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e4eca775-6681-491e-8d13-58fa2a639378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09539e5b-f3f4-4979-b9e6-6e2d8b88e04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:48 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Volume 374202f6-395d-4da4-b129-5bfd5c5c89b3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-374202f6-395d-4da4-b129-5bfd5c5c89b3', 'volume_size': 1} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:49Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=374202f6-395d-4da4-b129-5bfd5c5c89b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06553e0ca8fb4a48a25247abdd6a916b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:49Z,use_quota=True,user_id='75917411344a4fe380034bb95e289064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Creating volume 374202f6-395d-4da4-b129-5bfd5c5c89b3 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:48 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:48 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 1073741824 Sep 18 00:50:48 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:49 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 1073741824" returned: 0 in 0.468s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:49 devstack sudo[105498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 Sep 18 00:50:49 devstack sudo[105498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:49 devstack sudo[105498]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] <== create_volume: return (767ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (09539e5b-f3f4-4979-b9e6-6e2d8b88e04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-374202f6-395d-4da4-b129-5bfd5c5c89b3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf40d93-8964-4628-b0cd-377c9a41877f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:49 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Volume volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 (374202f6-395d-4da4-b129-5bfd5c5c89b3): created successfully Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8bf40d93-8964-4628-b0cd-377c9a41877f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Flow 'volume_create_manager' (815d70f7-d2ce-4165-bb51-1e3315723dea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a3d0f487-f4a4-4048-90ea-8b88cf0c2c5f tempest-CinderUnicodeTest-1042736197 None] Created volume successfully. Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Flow 'volume_create_manager' (f6f66b3c-71d2-47e3-92c2-b6daef45e51d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f542c41-2430-42c5-b0cb-d9dcc3a8ea08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f542c41-2430-42c5-b0cb-d9dcc3a8ea08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1550575021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d039f9e1-4b5d-4f3d-99ad-451db1ef98ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06553e0ca8fb4a48a25247abdd6a916b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:50Z,use_quota=True,user_id='75917411344a4fe380034bb95e289064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ddb034-788d-45fb-aa4a-5316e66edae0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6ddb034-788d-45fb-aa4a-5316e66edae0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623e881c-044a-4e26-999d-2a60f8597c05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (623e881c-044a-4e26-999d-2a60f8597c05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd039f9e1-4b5d-4f3d-99ad-451db1ef98ec', 'volume_name': 'volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41088cea-99ea-467c-9407-145331a17e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41088cea-99ea-467c-9407-145331a17e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809e33c2-f8ca-4a85-901a-321933ac2070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:50 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Volume d039f9e1-4b5d-4f3d-99ad-451db1ef98ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec', 'volume_size': 1} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:50Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1550575021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d039f9e1-4b5d-4f3d-99ad-451db1ef98ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='06553e0ca8fb4a48a25247abdd6a916b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:50Z,use_quota=True,user_id='75917411344a4fe380034bb95e289064',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Creating volume d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:50 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:50 devstack sudo[105501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec 1073741824 Sep 18 00:50:50 devstack sudo[105501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:50 devstack sudo[105501]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec 1073741824" returned: 0 in 0.459s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:51 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec Sep 18 00:50:51 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (afe0208a-8eca-49d5-8e49-e681c76f2fbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba589438-7e8f-4e65-9bec-116e9eb15670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba589438-7e8f-4e65-9bec-116e9eb15670) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233310017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfa123d-3242-40e6-931e-122562c33f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:51Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9c9f92-d1a1-4bd7-bad0-7262a4a653af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d9c9f92-d1a1-4bd7-bad0-7262a4a653af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e11c9fb-db81-4c9c-877d-162bc2e7b976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e11c9fb-db81-4c9c-877d-162bc2e7b976) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bdfa123d-3242-40e6-931e-122562c33f1a', 'volume_name': 'volume-bdfa123d-3242-40e6-931e-122562c33f1a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ed3fd4-0c22-4753-aea6-a5cdb70a8d6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01ed3fd4-0c22-4753-aea6-a5cdb70a8d6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932464f5-0ed0-47b1-b3f1-bb57c5e16278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:51 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Volume bdfa123d-3242-40e6-931e-122562c33f1a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bdfa123d-3242-40e6-931e-122562c33f1a', 'volume_size': 1} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:51 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] <== create_volume: return (772ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.776s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.046s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233310017',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bdfa123d-3242-40e6-931e-122562c33f1a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:51Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Creating volume bdfa123d-3242-40e6-931e-122562c33f1a {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:51 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (809e33c2-f8ca-4a85-901a-321933ac2070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack sudo[105511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a 1073741824 Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a39afa-cdaf-4395-a8ab-5a2f9397a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:51 devstack sudo[105511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:51 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Volume volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec (d039f9e1-4b5d-4f3d-99ad-451db1ef98ec): created successfully Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47a39afa-cdaf-4395-a8ab-5a2f9397a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Flow 'volume_create_manager' (f6f66b3c-71d2-47e3-92c2-b6daef45e51d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-43e5180e-80df-4e84-90b6-9e41af33f2f0 tempest-CinderUnicodeTest-1042736197 None] Created volume successfully. Sep 18 00:50:51 devstack sudo[105511]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a 1073741824" returned: 0 in 0.408s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:51 devstack sudo[105517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a Sep 18 00:50:51 devstack sudo[105517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:51 devstack sudo[105517]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a" returned: 0 in 0.243s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (932464f5-0ed0-47b1-b3f1-bb57c5e16278) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bdfa123d-3242-40e6-931e-122562c33f1a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f82aab2-6ddd-410f-9304-eeda887c4c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:51 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Volume volume-bdfa123d-3242-40e6-931e-122562c33f1a (bdfa123d-3242-40e6-931e-122562c33f1a): created successfully Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4f82aab2-6ddd-410f-9304-eeda887c4c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (afe0208a-8eca-49d5-8e49-e681c76f2fbe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f29a7b50-23ca-411e-93bd-3636c4ebf1ed tempest-ProjectReaderTests-406485066 None] Created volume successfully. Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-bdfa123d-3242-40e6-931e-122562c33f1a-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Lock "cinder-bdfa123d-3242-40e6-931e-122562c33f1a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-quobyte-bdfa123d-3242-40e6-931e-122562c33f1a" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-bdfa123d-3242-40e6-931e-122562c33f1a" acquired by "delete_volume" :: waited 0.013s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac339e17-e441-4023-a5ee-b11ddd05236e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:52 devstack sudo[105520]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a Sep 18 00:50:52 devstack sudo[105520]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Creating offline snapshot a6f9a2de-b966-48ef-9ce9-96393e16ca57 of volume d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37140c5-9458-45f2-b38e-e39034f2ad6e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:52 devstack sudo[105520]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a" returned: 0 in 0.380s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:52 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a Sep 18 00:50:52 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:52 devstack sudo[105525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec Sep 18 00:50:52 devstack sudo[105525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:53 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-bdfa123d-3242-40e6-931e-122562c33f1a" returned: 0 in 0.255s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-bdfa123d-3242-40e6-931e-122562c33f1a" released by "delete_volume" :: held 0.686s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Created reservations ['0e4e2d15-55c0-4d26-8c2c-450381a5996d', 'e6ff6fa5-ade9-4cc6-bdd2-b8afbfc640e5', '4fae426d-f3e5-45f4-811d-3cef22b69c8a', 'cd3cbe96-ab3d-40a8-bea9-8326a5c2ce31'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:53 devstack sudo[105525]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" returned: 0 in 0.385s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:53 devstack sudo[105533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 1G Sep 18 00:50:53 devstack sudo[105533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:53 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:53 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:53 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Deleted volume successfully. Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5444174d-f461-47d0-b444-e2a38ba1e727 tempest-ProjectReaderTests-406485066 None] Lock "cinder-bdfa123d-3242-40e6-931e-122562c33f1a-delete_volume" released by "delete_volume" :: held 1.172s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:53 devstack sudo[105533]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 1G" returned: 0 in 0.475s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:53 devstack sudo[105542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 Sep 18 00:50:53 devstack sudo[105542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (6f7a289d-98c3-4cea-b308-043fe12b5996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:53 devstack sudo[105542]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8fc8f8-c0fa-4f09-91f9-c016415f7a93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57" returned: 0 in 0.347s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:53 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 is being set with open permissions: ugo+rw Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a8fc8f8-c0fa-4f09-91f9-c016415f7a93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1757899740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2807b0c-3981-4da1-9941-fb1369abbb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:54Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:53 devstack sudo[105547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 Sep 18 00:50:53 devstack sudo[105547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a71e69-98c1-4cd8-91aa-bbb9f43731f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (01a71e69-98c1-4cd8-91aa-bbb9f43731f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9516582a-c0d8-4de7-b04a-7820d1fa9512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9516582a-c0d8-4de7-b04a-7820d1fa9512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a2807b0c-3981-4da1-9941-fb1369abbb92', 'volume_name': 'volume-a2807b0c-3981-4da1-9941-fb1369abbb92', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2095e0e-f138-4113-96c7-20a07c607c9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2095e0e-f138-4113-96c7-20a07c607c9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a88814-aae5-458d-981d-bfcc17e7df49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:54 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Volume a2807b0c-3981-4da1-9941-fb1369abbb92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a2807b0c-3981-4da1-9941-fb1369abbb92', 'volume_size': 1} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:54 devstack sudo[105547]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:54 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.info Sep 18 00:50:54 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:54 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.info" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:54 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.info is being set with open permissions: ugo+rw Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:54 devstack sudo[105553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.info Sep 18 00:50:54 devstack sudo[105553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:54 devstack sudo[105553]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.info" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.076s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.774s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1757899740',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2807b0c-3981-4da1-9941-fb1369abbb92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:54Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Creating volume a2807b0c-3981-4da1-9941-fb1369abbb92 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:54 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:54 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 1073741824 Sep 18 00:50:54 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:54 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-66d5a1e7-1c5a-4e25-9cba-3a43abd7cfe9 tempest-CinderUnicodeTest-1042736197 None] Create snapshot completed successfully Sep 18 00:50:55 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 1073741824" returned: 0 in 0.415s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:55 devstack sudo[105562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 Sep 18 00:50:55 devstack sudo[105562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:55 devstack sudo[105562]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92" returned: 0 in 0.244s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35a88814-aae5-458d-981d-bfcc17e7df49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2807b0c-3981-4da1-9941-fb1369abbb92', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744858de-3698-4598-b54a-025832926bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:55 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Volume volume-a2807b0c-3981-4da1-9941-fb1369abbb92 (a2807b0c-3981-4da1-9941-fb1369abbb92): created successfully Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (744858de-3698-4598-b54a-025832926bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (6f7a289d-98c3-4cea-b308-043fe12b5996) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:55 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d89edda7-ccf7-409b-bed4-c456e9d76078 tempest-ProjectReaderTests-406485066 None] Created volume successfully. Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "cinder-a6f9a2de-b966-48ef-9ce9-96393e16ca57-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-a6f9a2de-b966-48ef-9ce9-96393e16ca57-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "cinder-quobyte-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "cinder-quobyte-a6f9a2de-b966-48ef-9ce9-96393e16ca57" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-a6f9a2de-b966-48ef-9ce9-96393e16ca57" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Deleting offline snapshot a6f9a2de-b966-48ef-9ce9-96393e16ca57 of volume d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] snapshot_file for this snap is: volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[735f6540-65cd-4e68-874d-e1364708c5e7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-a2807b0c-3981-4da1-9941-fb1369abbb92-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Lock "cinder-a2807b0c-3981-4da1-9941-fb1369abbb92-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:56 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 Sep 18 00:50:56 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-quobyte-a2807b0c-3981-4da1-9941-fb1369abbb92" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-a2807b0c-3981-4da1-9941-fb1369abbb92" acquired by "delete_volume" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65206c6-31d8-49e5-b586-0c1dfc651d3b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:56 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 Sep 18 00:50:56 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:56 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57" returned: 0 in 0.391s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9dffe113-7776-45c9-bb49-bdca7aa9eed5]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:56 devstack sudo[105572]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec Sep 18 00:50:56 devstack sudo[105572]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:56 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92" returned: 0 in 0.381s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:56 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92 Sep 18 00:50:56 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:56 devstack sudo[105572]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" returned: 0 in 0.367s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:56 devstack sudo[105583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 Sep 18 00:50:56 devstack sudo[105583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:56 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a2807b0c-3981-4da1-9941-fb1369abbb92" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-a2807b0c-3981-4da1-9941-fb1369abbb92" released by "delete_volume" :: held 0.693s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Created reservations ['ebfa30b2-c090-4eab-917f-6853c81ce2b4', '8d22d598-23aa-40e3-9c28-7fd71d66b560', 'bb90de63-a84f-4c2c-90e5-1b88e1ced1d1', '35709555-243c-42b8-9b36-bd4e7fdda52a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:56 devstack sudo[105585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:56 devstack sudo[105585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:57 devstack sudo[105583]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57" returned: 0 in 0.354s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:57 devstack sudo[105591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57 Sep 18 00:50:57 devstack sudo[105591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:57 devstack sudo[105585]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.294s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:57 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Deleted volume successfully. Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-68f2ed4b-9bfd-4f8d-a600-10ac1b20bf24 tempest-ProjectReaderTests-406485066 None] Lock "cinder-a2807b0c-3981-4da1-9941-fb1369abbb92-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:57 devstack sudo[105591]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec.a6f9a2de-b966-48ef-9ce9-96393e16ca57" returned: 0 in 0.272s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-a6f9a2de-b966-48ef-9ce9-96393e16ca57" released by "_delete_snapshot" :: held 1.526s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" released by "delete_snapshot" :: held 1.554s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Created reservations ['31bd4445-a56e-4ef5-bcf1-9a1aa502e891', '46ee890e-9bd1-49d0-9c66-f4a5950cf68d', 'a14463bd-1fc5-4c96-a45e-56f89ab9e53d', 'fc6fc8d3-d226-404e-89f3-2b43b0742fde'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:57 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Delete snapshot completed successfully. Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-73074c72-303d-4838-80a1-f38b9813edc7 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-a6f9a2de-b966-48ef-9ce9-96393e16ca57-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (52b62874-9991-4f8e-9d6c-f0651fd09f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c235acce-d4bd-4526-82cd-e3fe6820b55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c235acce-d4bd-4526-82cd-e3fe6820b55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233342062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d43958-bff2-488e-87c9-be5a8c128590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:58Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f8f872-058a-44ea-b31d-3fe0f898966b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31f8f872-058a-44ea-b31d-3fe0f898966b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d57a591-88ad-426f-baaa-91a02d1cd9c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1d57a591-88ad-426f-baaa-91a02d1cd9c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d43958-bff2-488e-87c9-be5a8c128590', 'volume_name': 'volume-a6d43958-bff2-488e-87c9-be5a8c128590', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a5974f-5166-4a3c-83b7-75b89cc1e676) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01a5974f-5166-4a3c-83b7-75b89cc1e676) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a927c1-fcf4-47e6-ab26-5657136139c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:57 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Volume a6d43958-bff2-488e-87c9-be5a8c128590: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d43958-bff2-488e-87c9-be5a8c128590', 'volume_size': 1} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:50:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-233342062',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d43958-bff2-488e-87c9-be5a8c128590,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:50:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:50:58Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Creating volume a6d43958-bff2-488e-87c9-be5a8c128590 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:50:57 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:50:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:57 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 1073741824 Sep 18 00:50:57 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "cinder-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "cinder-quobyte-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d4300a-e369-4fc0-871c-8b6321deeebb]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:58 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 1073741824" returned: 0 in 0.467s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:58 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec Sep 18 00:50:58 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:58 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 Sep 18 00:50:58 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:58 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590" returned: 0 in 0.247s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:58 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" returned: 0 in 0.375s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (75a927c1-fcf4-47e6-ab26-5657136139c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d43958-bff2-488e-87c9-be5a8c128590', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:58 devstack sudo[105609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec Sep 18 00:50:58 devstack sudo[105609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38773aac-eeed-40ee-bc60-64939961c83d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:50:58 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Volume volume-a6d43958-bff2-488e-87c9-be5a8c128590 (a6d43958-bff2-488e-87c9-be5a8c128590): created successfully Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38773aac-eeed-40ee-bc60-64939961c83d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (52b62874-9991-4f8e-9d6c-f0651fd09f13) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:50:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-639b8080-d576-41c0-b13a-55d34edc84df tempest-ProjectReaderTests-406485066 None] Created volume successfully. Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-a6d43958-bff2-488e-87c9-be5a8c128590-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:58 devstack sudo[105609]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Lock "cinder-a6d43958-bff2-488e-87c9-be5a8c128590-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec" released by "delete_volume" :: held 0.715s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-quobyte-a6d43958-bff2-488e-87c9-be5a8c128590" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-a6d43958-bff2-488e-87c9-be5a8c128590" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[28d964b5-1873-48d1-a149-adc900b9c468]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Created reservations ['8cf3f4f5-882c-4c0d-85b4-43f223ff5299', 'dbe86ab9-f6a1-4898-8e22-008239c38d82', '0edbf753-7ae1-4818-a29d-065b45fad1b6', 'e7705508-c856-418a-97e0-bbeb4152b39b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:59 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 Sep 18 00:50:59 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:59 devstack sudo[105613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:59 devstack sudo[105613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "cinder-374202f6-395d-4da4-b129-5bfd5c5c89b3-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-374202f6-395d-4da4-b129-5bfd5c5c89b3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:59 devstack sudo[105613]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:50:59 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Deleted volume successfully. Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "cinder-quobyte-374202f6-395d-4da4-b129-5bfd5c5c89b3" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-fb9e54d5-0e21-41d5-b8cd-b94fde9f2ea4 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-d039f9e1-4b5d-4f3d-99ad-451db1ef98ec-delete_volume" released by "delete_volume" :: held 1.295s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-374202f6-395d-4da4-b129-5bfd5c5c89b3" acquired by "delete_volume" :: waited 0.033s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:50:59 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590" returned: 0 in 0.484s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[427a0a99-684f-49a1-8ee2-b7e85d380e10]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:59 devstack sudo[105622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590 Sep 18 00:50:59 devstack sudo[105622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:59 devstack sudo[105623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 Sep 18 00:50:59 devstack sudo[105623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:59 devstack sudo[105622]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a6d43958-bff2-488e-87c9-be5a8c128590" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-a6d43958-bff2-488e-87c9-be5a8c128590" released by "delete_volume" :: held 0.797s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Created reservations ['49491750-3ccf-4f9d-9e11-59a89490a998', 'c7a6d5aa-1b74-4d3d-836e-570f8d823495', '65e8b6c4-50eb-4562-b46c-a3f61677ef5f', 'a9d1e329-ea15-4f82-a5af-7dbfe9638278'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:59 devstack sudo[105623]: pam_unix(sudo:session): session closed for user root Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:50:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:50:59 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:50:59 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:50:59 devstack sudo[105632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3 Sep 18 00:50:59 devstack sudo[105632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:00 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Deleted volume successfully. Sep 18 00:51:00 devstack sudo[105632]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-374202f6-395d-4da4-b129-5bfd5c5c89b3" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-quobyte-374202f6-395d-4da4-b129-5bfd5c5c89b3" released by "delete_volume" :: held 0.729s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-61735793-377a-4a97-ba04-936236ffbbd1 tempest-ProjectReaderTests-406485066 None] Lock "cinder-a6d43958-bff2-488e-87c9-be5a8c128590-delete_volume" released by "delete_volume" :: held 1.320s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Created reservations ['d8e79e18-3956-4ea6-8370-293295b0a2dc', '4c44e918-fe9d-493d-90fa-5fbee378ec0c', 'd67813a1-20e5-43b2-a13a-1ce11a48da84', 'b48fe7c6-b7cd-4487-a3fc-1ad772d32091'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:00 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:00 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (92efad8f-0447-4edc-b46f-8d5bcf7975fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c353dbdc-328a-42ff-9664-f98b4e00fee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c353dbdc-328a-42ff-9664-f98b4e00fee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987252905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e13709-9648-4b71-92ea-5d6b4d9ebc51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:00Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d4da35-1114-40f0-b446-b890be50e1bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37d4da35-1114-40f0-b446-b890be50e1bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:00 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7027470a-d610-496e-8c2d-2d14b4d6776b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7027470a-d610-496e-8c2d-2d14b4d6776b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16e13709-9648-4b71-92ea-5d6b4d9ebc51', 'volume_name': 'volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d96065-1cc0-426e-8cce-08844e389f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71d96065-1cc0-426e-8cce-08844e389f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deafdb66-69ec-4502-9c9e-cd6d9d110c16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:00 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Volume 16e13709-9648-4b71-92ea-5d6b4d9ebc51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51', 'volume_size': 1} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-987252905',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16e13709-9648-4b71-92ea-5d6b4d9ebc51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0712c9ee164aea827950d5b43306c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:00Z,use_quota=True,user_id='37a0a57a96fd4943a97f4590477e2a6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Creating volume 16e13709-9648-4b71-92ea-5d6b4d9ebc51 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:00 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.305s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Deleted volume successfully. Sep 18 00:51:00 devstack sudo[105639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 1073741824 Sep 18 00:51:00 devstack sudo[105639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7eac99d1-8023-4aa4-a5fe-532d37ec9020 tempest-CinderUnicodeTest-1042736197 None] Lock "cinder-374202f6-395d-4da4-b129-5bfd5c5c89b3-delete_volume" released by "delete_volume" :: held 1.307s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:01 devstack sudo[105639]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 1073741824" returned: 0 in 0.531s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:01 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 Sep 18 00:51:01 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:01 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51" returned: 0 in 0.280s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (deafdb66-69ec-4502-9c9e-cd6d9d110c16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbe59be-b142-43d0-90c7-255605798ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:01 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Volume volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 (16e13709-9648-4b71-92ea-5d6b4d9ebc51): created successfully Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9fbe59be-b142-43d0-90c7-255605798ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Flow 'volume_create_manager' (92efad8f-0447-4edc-b46f-8d5bcf7975fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:01 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e110cf51-fe63-4ce6-9f79-b91d3b8259b2 tempest-ProjectReaderTests-406485066 None] Created volume successfully. Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-16e13709-9648-4b71-92ea-5d6b4d9ebc51-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Lock "cinder-16e13709-9648-4b71-92ea-5d6b4d9ebc51-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Acquiring lock "cinder-quobyte-16e13709-9648-4b71-92ea-5d6b4d9ebc51" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-16e13709-9648-4b71-92ea-5d6b4d9ebc51" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a86d2a20-747b-44ea-b5c0-18fb302bd900]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:02 devstack sudo[105651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 Sep 18 00:51:02 devstack sudo[105651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:02 devstack sudo[105651]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51" returned: 0 in 0.350s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:03 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51 Sep 18 00:51:03 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:03 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-16e13709-9648-4b71-92ea-5d6b4d9ebc51" returned: 0 in 0.247s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Lock "cinder-quobyte-16e13709-9648-4b71-92ea-5d6b4d9ebc51" released by "delete_volume" :: held 0.640s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Created reservations ['d67b1b3a-5bba-4b8d-a8a3-259385d79080', 'a1f1e430-d2a2-4f69-bf23-87aaaca34679', '79377106-8757-4b35-ac59-69d3153baf75', 'a2c09fd2-cd1a-4ca9-927a-e54af3fd4597'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:03 devstack sudo[105659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:03 devstack sudo[105659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:03 devstack sudo[105659]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.245s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:03 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Deleted volume successfully. Sep 18 00:51:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bdaff3f8-9af7-48b0-bb3c-418f4c701801 tempest-ProjectReaderTests-406485066 None] Lock "cinder-16e13709-9648-4b71-92ea-5d6b4d9ebc51-delete_volume" released by "delete_volume" :: held 1.076s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:04 devstack sudo[105662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:04 devstack sudo[105662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:04 devstack sudo[105662]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.248s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 28 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:51:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:51:13 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=60,cinder:INSERT=26,cinder:UPDATE=85,cinder:DELETE=8 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:51:13 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=92,cinder:SELECT=58,cinder:DELETE=7,cinder:INSERT=17 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Flow 'volume_create_manager' (326e53fb-40d3-4cc4-aa0c-3ca197ab7036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a21762-f096-4c25-a61b-f889a70fa787) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (35a21762-f096-4c25-a61b-f889a70fa787) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537a6081-baed-4021-8244-ed9767e9e503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a23abaddf143bf90b96b51e8a2e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:16Z,use_quota=True,user_id='b5e339474d7649adb9334eba12aca400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd613960-cd63-49c2-a635-2156270e6889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd613960-cd63-49c2-a635-2156270e6889) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f569f-1140-46b8-a6de-25ef23129552) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (947f569f-1140-46b8-a6de-25ef23129552) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '537a6081-baed-4021-8244-ed9767e9e503', 'volume_name': 'volume-537a6081-baed-4021-8244-ed9767e9e503', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdb82d5-63e4-4087-9d12-304b3c94169c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecdb82d5-63e4-4087-9d12-304b3c94169c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bbaf77-0600-4325-a8fe-b245e1e15d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Volume 537a6081-baed-4021-8244-ed9767e9e503: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-537a6081-baed-4021-8244-ed9767e9e503', 'volume_size': 1} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=537a6081-baed-4021-8244-ed9767e9e503,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a23abaddf143bf90b96b51e8a2e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:16Z,use_quota=True,user_id='b5e339474d7649adb9334eba12aca400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Creating volume 537a6081-baed-4021-8244-ed9767e9e503 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:15 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:15 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 1073741824 Sep 18 00:51:15 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (3b27350d-7fd7-4fc2-b26e-bba3985fbd1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccaa26c-8e31-4d4c-aa97-1b12cd97e83a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5ccaa26c-8e31-4d4c-aa97-1b12cd97e83a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844686452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29f3d47-1ab1-416c-88a7-d1feb06f480f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:16Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff48819-8e03-42a1-bd20-a36b4621a620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bff48819-8e03-42a1-bd20-a36b4621a620) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd83bb65-de2e-4909-9459-9d6b1be17636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd83bb65-de2e-4909-9459-9d6b1be17636) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b29f3d47-1ab1-416c-88a7-d1feb06f480f', 'volume_name': 'volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de28e0aa-3659-4163-9dc2-ec306b670d8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de28e0aa-3659-4163-9dc2-ec306b670d8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7092f47d-a5bc-4c66-bf32-9f8889d4eb05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume b29f3d47-1ab1-416c-88a7-d1feb06f480f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f', 'volume_size': 1} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (833bbaa4-c917-47f4-9922-f5679eb0db3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:16 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e428d8ed-4dd4-4584-98c6-8900a0c256a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 1073741824" returned: 0 in 0.618s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e428d8ed-4dd4-4584-98c6-8900a0c256a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390464344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659b5c10-2f5a-46a7-b96f-802358acddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:16Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcd9295-9a7e-4d15-8a41-03ff49e57351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dcd9295-9a7e-4d15-8a41-03ff49e57351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d41f17-13f3-4fcf-ba34-d5c23c009a82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20d41f17-13f3-4fcf-ba34-d5c23c009a82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '659b5c10-2f5a-46a7-b96f-802358acddbe', 'volume_name': 'volume-659b5c10-2f5a-46a7-b96f-802358acddbe', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c967374-fb91-40ca-8d13-7c6e6130c4b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c967374-fb91-40ca-8d13-7c6e6130c4b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3bb913-637c-4896-ba91-9095b044870b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume 659b5c10-2f5a-46a7-b96f-802358acddbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-659b5c10-2f5a-46a7-b96f-802358acddbe', 'volume_size': 1} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:16 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 Sep 18 00:51:16 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:16 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] <== create_volume: return (992ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.837s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844686452',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b29f3d47-1ab1-416c-88a7-d1feb06f480f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:16Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Creating volume b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:16 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (96bbaf77-0600-4325-a8fe-b245e1e15d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-537a6081-baed-4021-8244-ed9767e9e503', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f 1073741824 Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc64ef4-1c36-4ee3-80c8-c321ecb8a94e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:16 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:16 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Volume volume-537a6081-baed-4021-8244-ed9767e9e503 (537a6081-baed-4021-8244-ed9767e9e503): created successfully Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bdc64ef4-1c36-4ee3-80c8-c321ecb8a94e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:16 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Flow 'volume_create_manager' (326e53fb-40d3-4cc4-aa0c-3ca197ab7036) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cbe98409-db44-420f-b30e-ed98c9e595f4 tempest-CinderUnicodeTest-1546026564 None] Created volume successfully. Sep 18 00:51:17 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f 1073741824" returned: 0 in 0.458s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:17 devstack sudo[105760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f Sep 18 00:51:17 devstack sudo[105760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:17 devstack sudo[105760]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f" returned: 0 in 0.248s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] <== create_volume: return (748ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.073s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390464344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=659b5c10-2f5a-46a7-b96f-802358acddbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:16Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Creating volume 659b5c10-2f5a-46a7-b96f-802358acddbe {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:17 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7092f47d-a5bc-4c66-bf32-9f8889d4eb05) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:17 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe 1073741824 Sep 18 00:51:17 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c2e6fc-80e2-4d14-bbe7-56e1b260e79d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f (b29f3d47-1ab1-416c-88a7-d1feb06f480f): created successfully Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76c2e6fc-80e2-4d14-bbe7-56e1b260e79d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (3b27350d-7fd7-4fc2-b26e-bba3985fbd1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a16a2ecd-d9cd-4980-8267-e24ddff43df6 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created volume successfully. Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:18 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe 1073741824" returned: 0 in 0.583s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:18 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe Sep 18 00:51:18 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Flow 'volume_create_manager' (ed22c762-0fe5-4e72-959b-192cb50eea33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9528c-f260-460a-bf1b-851d340c225a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f9528c-f260-460a-bf1b-851d340c225a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-142369551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7136591-8b12-4a8a-be59-a884d177d5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a23abaddf143bf90b96b51e8a2e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:18Z,use_quota=True,user_id='b5e339474d7649adb9334eba12aca400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe8250-e26b-49fe-b281-28e4e06be42a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ebe8250-e26b-49fe-b281-28e4e06be42a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cc2c39-6b7e-4580-a415-d3f30c446577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6cc2c39-6b7e-4580-a415-d3f30c446577) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f7136591-8b12-4a8a-be59-a884d177d5eb', 'volume_name': 'volume-f7136591-8b12-4a8a-be59-a884d177d5eb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b6e95a-1599-4db9-8d64-d530283fd511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66b6e95a-1599-4db9-8d64-d530283fd511) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b24e18e-3e6b-4f67-a553-b7006bf728ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Volume f7136591-8b12-4a8a-be59-a884d177d5eb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f7136591-8b12-4a8a-be59-a884d177d5eb', 'volume_size': 1} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:18 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe" returned: 0 in 0.282s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] <== create_volume: return (907ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.444s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff3bb913-637c-4896-ba91-9095b044870b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-659b5c10-2f5a-46a7-b96f-802358acddbe', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea808b48-944d-4ea5-87a5-0772b77bf011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Creating offline snapshot 16b16f9a-6a5c-462b-a8ab-2feadf8603a4 of volume b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:51:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume volume-659b5c10-2f5a-46a7-b96f-802358acddbe (659b5c10-2f5a-46a7-b96f-802358acddbe): created successfully Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea808b48-944d-4ea5-87a5-0772b77bf011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (833bbaa4-c917-47f4-9922-f5679eb0db3b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3905325f-7c9a-42d6-a3e2-7d881ad1275a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:18 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8db02a0f-9cc7-4efc-8dc3-19a4c854f495 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created volume successfully. Sep 18 00:51:18 devstack sudo[105772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f Sep 18 00:51:18 devstack sudo[105772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:18 devstack sudo[105772]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f" returned: 0 in 0.387s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:18 devstack sudo[105777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 1G Sep 18 00:51:18 devstack sudo[105777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:19 devstack sudo[105777]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 1G" returned: 0 in 0.497s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:19 devstack sudo[105783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 Sep 18 00:51:19 devstack sudo[105783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Flow 'volume_create_manager' (772af212-0500-4b86-99f3-8b8ac98375f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98363493-fcdc-4557-9469-d939469d9de7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98363493-fcdc-4557-9469-d939469d9de7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95494b1-60bf-4e8a-ab21-47d1666f33bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed770dab46f4d02b8620e8c20eaab4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:19Z,use_quota=True,user_id='4808c3805f994d77bb1349fb494ba11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ee4af6f-5d00-4dd5-88eb-8aa39f63e58a),volume_type_id=1ee4af6f-5d00-4dd5-88eb-8aa39f63e58a)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a489a76-27c8-45d1-baee-56805eab4877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a489a76-27c8-45d1-baee-56805eab4877) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a0b784-fa44-4295-a429-ec25b57d646e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:51:19 devstack sudo[105783]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4" returned: 0 in 0.330s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:19 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 is being set with open permissions: ugo+rw Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:19 devstack sudo[105788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 Sep 18 00:51:19 devstack sudo[105788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8a0b784-fa44-4295-a429-ec25b57d646e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c95494b1-60bf-4e8a-ab21-47d1666f33bc', 'volume_name': 'volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc', 'volume_size': 1, 'image_id': 'caffe6d8-a9c1-4d98-b518-8537cf569e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/caffe6d8-a9c1-4d98-b518-8537cf569e92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c9382c24ed5b196543ce4a9f22136a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ed770dab46f4d02b8620e8c20eaab4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0b3d74be3eb6d7a17f5763a0bd8f5d798218394d745ac5700950fd50e03f25e421d8fb3671aa437665e9a99bcec8aec33c2af633068bc3dba00e946d8f93dd4', 'id': 'caffe6d8-a9c1-4d98-b518-8537cf569e92', 'created_at': datetime.datetime(2026, 9, 17, 22, 51, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 51, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/caffe6d8-a9c1-4d98-b518-8537cf569e92/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac04362-a7ee-4de4-832a-acbdea577d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dac04362-a7ee-4de4-832a-acbdea577d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b5e33-2c20-42b2-bc47-30ad2e5ab77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Volume c95494b1-60bf-4e8a-ab21-47d1666f33bc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc', 'volume_size': 1, 'image_id': 'caffe6d8-a9c1-4d98-b518-8537cf569e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/caffe6d8-a9c1-4d98-b518-8537cf569e92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c9382c24ed5b196543ce4a9f22136a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ed770dab46f4d02b8620e8c20eaab4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0b3d74be3eb6d7a17f5763a0bd8f5d798218394d745ac5700950fd50e03f25e421d8fb3671aa437665e9a99bcec8aec33c2af633068bc3dba00e946d8f93dd4', 'id': 'caffe6d8-a9c1-4d98-b518-8537cf569e92', 'created_at': datetime.datetime(2026, 9, 17, 22, 51, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 51, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/caffe6d8-a9c1-4d98-b518-8537cf569e92/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 18 00:51:19 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Trying to clone c95494b1-60bf-4e8a-ab21-47d1666f33bc from image caffe6d8-a9c1-4d98-b518-8537cf569e92 at location (None, [{'url': 'file:///opt/stack/data/glance/images/caffe6d8-a9c1-4d98-b518-8537cf569e92', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:51:20 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Image download 0.00 MB at 0.00 MB/s Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (09b01ef5-95ee-4af4-9bd7-87654fda0cf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4f2013-f756-4b95-a0da-01ac48785447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5dfa057-f939-4ede-a112-fa49a7725757]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa4f2013-f756-4b95-a0da-01ac48785447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920692789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc703aa-a452-48a0-9745-9174a790589b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:20Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack sudo[105788]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6ed709-fe83-4d6c-ab8a-d3424629b490) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c6ed709-fe83-4d6c-ab8a-d3424629b490) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed956d5-eb1a-44b3-90ca-2acf47fc7acc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ed956d5-eb1a-44b3-90ca-2acf47fc7acc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cbc703aa-a452-48a0-9745-9174a790589b', 'volume_name': 'volume-cbc703aa-a452-48a0-9745-9174a790589b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26112fb-bc0b-4910-bfc8-c3a15a37e963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b26112fb-bc0b-4910-bfc8-c3a15a37e963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996602e7-54c6-4e3f-b3b5-757fc5319f2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume cbc703aa-a452-48a0-9745-9174a790589b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cbc703aa-a452-48a0-9745-9174a790589b', 'volume_size': 1} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:20 devstack sudo[105791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD Sep 18 00:51:20 devstack sudo[105791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:20 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.info Sep 18 00:51:20 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:20 devstack sudo[105791]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD" returned: 0 in 0.387s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:20 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (b5026144-57ea-4fdd-a666-49707567e5cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0f9a1b-1c67-4762-a410-b57e92497fe3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.info" returned: 0 in 0.352s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:20 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.info is being set with open permissions: ugo+rw Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:20 devstack sudo[105799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.info Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb0f9a1b-1c67-4762-a410-b57e92497fe3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931279296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515aab2e-eb11-4815-a9cf-e68f9acb4f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:20Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack sudo[105799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83658fb7-ef24-46e3-9821-fd17ae6122d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83658fb7-ef24-46e3-9821-fd17ae6122d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12971423-49e2-4f30-a9c2-520bc2cc2634) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (12971423-49e2-4f30-a9c2-520bc2cc2634) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '515aab2e-eb11-4815-a9cf-e68f9acb4f09', 'volume_name': 'volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD Sep 18 00:51:20 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a377e-cc02-418a-8d8a-2b46bdfb2c45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (772a377e-cc02-418a-8d8a-2b46bdfb2c45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cabae12-f5b3-4198-8046-294abd9efebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume 515aab2e-eb11-4815-a9cf-e68f9acb4f09: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09', 'volume_size': 1} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:20 devstack sudo[105799]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.info" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:20 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.370s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.446s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:18Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-142369551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7136591-8b12-4a8a-be59-a884d177d5eb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a23abaddf143bf90b96b51e8a2e760',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:18Z,use_quota=True,user_id='b5e339474d7649adb9334eba12aca400',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Creating volume f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:20 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD" returned: 1 in 0.432s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Temporary image caffe6d8-a9c1-4d98-b518-8537cf569e92 is fetched for user 4808c3805f994d77bb1349fb494ba11c. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:51:20 devstack sudo[105806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb 1073741824 Sep 18 00:51:20 devstack sudo[105806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ebc1ffbf-d230-44ce-8d62-cefb0830dcea tempest-CreateVolumesFromSnapshotTest-1755428680 None] Create snapshot completed successfully Sep 18 00:51:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (0885df45-8d1d-45c7-a555-4264f421ba2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ab592a-97ce-4b3f-8d2a-ed6164de881d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8ab592a-97ce-4b3f-8d2a-ed6164de881d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916606151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f783915-8f99-4aea-a574-f115867f672d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:21Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c24cc71-ef18-4265-87dd-701cfa8640fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c24cc71-ef18-4265-87dd-701cfa8640fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae43163-560f-4652-a2a7-7695e65dd951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6ae43163-560f-4652-a2a7-7695e65dd951) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f783915-8f99-4aea-a574-f115867f672d', 'volume_name': 'volume-2f783915-8f99-4aea-a574-f115867f672d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e752748-6fbd-4cf7-93e0-a7f0ec049535) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e752748-6fbd-4cf7-93e0-a7f0ec049535) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70313244-f119-4d0c-94c1-b00faee2221b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume 2f783915-8f99-4aea-a574-f115867f672d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f783915-8f99-4aea-a574-f115867f672d', 'volume_size': 1} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b493e099-0ef8-483e-b6ce-ddb48719d0dc]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:21 devstack sudo[105809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD Sep 18 00:51:21 devstack sudo[105809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (37a91e73-8207-40f6-a4a1-0aa797e916ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1879f5-8662-4cb3-89e0-be3c0693bc1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c1879f5-8662-4cb3-89e0-be3c0693bc1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-615224205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a48f89-3b62-44c3-b225-9e13e17ba8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:21Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bde7aad-2a43-447d-a4fc-fd7e6c8f1ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6bde7aad-2a43-447d-a4fc-fd7e6c8f1ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50db85a0-d2fd-47e1-b2f4-3c43d17e83fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50db85a0-d2fd-47e1-b2f4-3c43d17e83fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0a48f89-3b62-44c3-b225-9e13e17ba8c1', 'volume_name': 'volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0056e4b-a913-4b06-a360-527308de2268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0056e4b-a913-4b06-a360-527308de2268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e6566c-6814-41db-b797-0208fb02fdee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume c0a48f89-3b62-44c3-b225-9e13e17ba8c1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1', 'volume_size': 1} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:21 devstack sudo[105806]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb 1073741824" returned: 0 in 0.634s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:21 devstack sudo[105809]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD" returned: 0 in 0.460s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:21 devstack sudo[105817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb Sep 18 00:51:21 devstack sudo[105817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:21 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD Sep 18 00:51:21 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:21 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD" returned: 1 in 0.405s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:21 devstack sudo[105817]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb" returned: 0 in 0.407s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] <== create_volume: return (1105ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.109s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.825s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-920692789',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cbc703aa-a452-48a0-9745-9174a790589b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:20Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Creating volume cbc703aa-a452-48a0-9745-9174a790589b {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:22 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8b24e18e-3e6b-4f67-a553-b7006bf728ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7136591-8b12-4a8a-be59-a884d177d5eb', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d895dfc-e9e7-41c0-abba-2b94d0711565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack sudo[105824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b 1073741824 Sep 18 00:51:22 devstack sudo[105824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Volume volume-f7136591-8b12-4a8a-be59-a884d177d5eb (f7136591-8b12-4a8a-be59-a884d177d5eb): created successfully Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d895dfc-e9e7-41c0-abba-2b94d0711565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Flow 'volume_create_manager' (ed22c762-0fe5-4e72-959b-192cb50eea33) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4ad1f746-f372-489d-a0a6-8693f741735a tempest-CinderUnicodeTest-1546026564 None] Created volume successfully. Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (a192979c-a7c2-4e7a-8858-172027fcc37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731a03a7-5812-4db7-a5b5-4a0c814724f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (731a03a7-5812-4db7-a5b5-4a0c814724f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049123816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446b52d8-ea00-4203-8ddc-c10d6a04a422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:22Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4e50e2-78e7-4adc-9a22-921fd31176ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a4e50e2-78e7-4adc-9a22-921fd31176ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578d692c-40ad-467c-a63d-5d85d253ea86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (578d692c-40ad-467c-a63d-5d85d253ea86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '446b52d8-ea00-4203-8ddc-c10d6a04a422', 'volume_name': 'volume-446b52d8-ea00-4203-8ddc-c10d6a04a422', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e701a63a-7931-451a-85df-f2aa91370de0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e701a63a-7931-451a-85df-f2aa91370de0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e665cd84-c73f-4a94-a1c5-b56a9199c476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume 446b52d8-ea00-4203-8ddc-c10d6a04a422: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-446b52d8-ea00-4203-8ddc-c10d6a04a422', 'volume_size': 1} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:22 devstack sudo[105824]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b 1073741824" returned: 0 in 0.549s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:22 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b Sep 18 00:51:22 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (e4138686-aa0e-4448-a078-3b5391fa980b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cedc46-53ca-45f9-83c1-2cfc745e62da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (46cedc46-53ca-45f9-83c1-2cfc745e62da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2003860619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d018bd2-f835-4705-8750-10a14d2a9f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c19bdb-bc0d-4724-95eb-bf2bf39a2246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5c19bdb-bc0d-4724-95eb-bf2bf39a2246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b3478e-4511-49ae-af41-104d46b3ffbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43b3478e-4511-49ae-af41-104d46b3ffbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d018bd2-f835-4705-8750-10a14d2a9f0d', 'volume_name': 'volume-6d018bd2-f835-4705-8750-10a14d2a9f0d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7ef353-994f-4707-80d2-4b22756d8a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7ef353-994f-4707-80d2-4b22756d8a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7d91f3-55eb-47f4-8294-e5d8140187d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume 6d018bd2-f835-4705-8750-10a14d2a9f0d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d018bd2-f835-4705-8750-10a14d2a9f0d', 'volume_size': 1} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (371997bd-6d09-4c8d-a907-72b73acb2066) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3a4951-8d83-4384-8cca-93bc6ec73a81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b3a4951-8d83-4384-8cca-93bc6ec73a81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-998578597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20e846f-0dd4-416e-8c64-2c917740e036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15216255-db3d-434a-b3a7-f14a0fad3d7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15216255-db3d-434a-b3a7-f14a0fad3d7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5ab237-43a6-4f28-8d21-0739a22837f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc5ab237-43a6-4f28-8d21-0739a22837f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd20e846f-0dd4-416e-8c64-2c917740e036', 'volume_name': 'volume-d20e846f-0dd4-416e-8c64-2c917740e036', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a59707e-a22f-4e6e-9517-5653a049e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a59707e-a22f-4e6e-9517-5653a049e351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8b9925-0d8a-4c47-ae72-86c6a9d55b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume d20e846f-0dd4-416e-8c64-2c917740e036: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d20e846f-0dd4-416e-8c64-2c917740e036', 'volume_size': 1} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:22 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (a45b45a7-6216-4234-8be6-d129cc14d556) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea629fa0-38a1-4c5c-804d-90b20e1f4070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b" returned: 0 in 0.352s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.307s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-931279296',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=515aab2e-eb11-4815-a9cf-e68f9acb4f09,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:20Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Creating volume 515aab2e-eb11-4815-a9cf-e68f9acb4f09 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:22 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ea629fa0-38a1-4c5c-804d-90b20e1f4070) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-396351635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7544db1-0aeb-4a83-a809-75ad1c9baf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4668d24d-5392-402a-bba3-a6bb082d9a71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4668d24d-5392-402a-bba3-a6bb082d9a71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ea0b7f-d25a-4e57-b420-a49406606b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e6ea0b7f-d25a-4e57-b420-a49406606b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7544db1-0aeb-4a83-a809-75ad1c9baf61', 'volume_name': 'volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 1073741824 Sep 18 00:51:23 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1bbd3f-66dc-48cc-946f-07d44abfccc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b1bbd3f-66dc-48cc-946f-07d44abfccc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaaf61d-a920-418c-8f29-5a526ad4f618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume d7544db1-0aeb-4a83-a809-75ad1c9baf61: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61', 'volume_size': 1} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (996602e7-54c6-4e3f-b3b5-757fc5319f2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cbc703aa-a452-48a0-9745-9174a790589b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c80a89-69d6-4788-85ad-4c5a32a62990) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume volume-cbc703aa-a452-48a0-9745-9174a790589b (cbc703aa-a452-48a0-9745-9174a790589b): created successfully Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3c80a89-69d6-4788-85ad-4c5a32a62990) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (09b01ef5-95ee-4af4-9bd7-87654fda0cf2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-21f60f9a-0465-4037-8cf3-67f9f2c45c5a tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created volume successfully. Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (8b3a6ad6-320d-4055-a025-2f70ec87c410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8205ffe5-bebd-410b-8a77-a05d6bd1fd8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8205ffe5-bebd-410b-8a77-a05d6bd1fd8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-945682115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3100c4-0a06-4187-8149-8a1a4441aeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8658ab7d-efce-4a10-b017-e6c99089e6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8658ab7d-efce-4a10-b017-e6c99089e6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4995c2a-0664-4eb7-af97-4c60fc0d3216) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4995c2a-0664-4eb7-af97-4c60fc0d3216) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b3100c4-0a06-4187-8149-8a1a4441aeda', 'volume_name': 'volume-0b3100c4-0a06-4187-8149-8a1a4441aeda', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926775d3-12bb-4558-a492-61a22c4f7720) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (926775d3-12bb-4558-a492-61a22c4f7720) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b633a7be-ecfc-4a63-a895-7181008ead67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume 0b3100c4-0a06-4187-8149-8a1a4441aeda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b3100c4-0a06-4187-8149-8a1a4441aeda', 'volume_size': 1} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:23 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 1073741824" returned: 0 in 0.604s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:23 devstack sudo[105840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 Sep 18 00:51:23 devstack sudo[105840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (26c3610b-faf0-4899-89fb-02bd599583f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e128469f-cda7-4815-a2a4-f431db14d7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e128469f-cda7-4815-a2a4-f431db14d7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321120244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a2ebfe-e5b3-420d-92ff-f8816e870838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:24Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d137b5b-8777-4cf7-8506-e5c4abc18355) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d137b5b-8777-4cf7-8506-e5c4abc18355) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffde9fe-3394-41c9-aeaa-82330fcfe58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dffde9fe-3394-41c9-aeaa-82330fcfe58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79a2ebfe-e5b3-420d-92ff-f8816e870838', 'volume_name': 'volume-79a2ebfe-e5b3-420d-92ff-f8816e870838', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3019318f-4e5d-467a-af2d-cd8471201c4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3019318f-4e5d-467a-af2d-cd8471201c4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e33decc-0b86-499c-bc54-aa4f15b4cf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume 79a2ebfe-e5b3-420d-92ff-f8816e870838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79a2ebfe-e5b3-420d-92ff-f8816e870838', 'volume_size': 1} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:23 devstack sudo[105840]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09" returned: 0 in 0.277s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] <== create_volume: return (928ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.936s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.829s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1916606151',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f783915-8f99-4aea-a574-f115867f672d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:21Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Creating volume 2f783915-8f99-4aea-a574-f115867f672d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cabae12-f5b3-4198-8046-294abd9efebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b033ddaa-8140-4d20-97ea-1098e35b77e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:23 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d 1073741824 Sep 18 00:51:23 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 (515aab2e-eb11-4815-a9cf-e68f9acb4f09): created successfully Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b033ddaa-8140-4d20-97ea-1098e35b77e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (b5026144-57ea-4fdd-a666-49707567e5cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7431c63a-79e7-49a9-8989-933a125a601b tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created volume successfully. Sep 18 00:51:24 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d 1073741824" returned: 0 in 0.460s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:24 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d Sep 18 00:51:24 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:24 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d" returned: 0 in 0.242s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] <== create_volume: return (740ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.147s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-615224205',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0a48f89-3b62-44c3-b225-9e13e17ba8c1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:21Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Creating volume c0a48f89-3b62-44c3-b225-9e13e17ba8c1 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:24 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:24 devstack sudo[105852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 1073741824 Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70313244-f119-4d0c-94c1-b00faee2221b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f783915-8f99-4aea-a574-f115867f672d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:24 devstack sudo[105852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597c58a9-e693-483b-be7e-674b6bcc793e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:24 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume volume-2f783915-8f99-4aea-a574-f115867f672d (2f783915-8f99-4aea-a574-f115867f672d): created successfully Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (597c58a9-e693-483b-be7e-674b6bcc793e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (0885df45-8d1d-45c7-a555-4264f421ba2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8b5527ed-21cf-4a4b-8dd2-5b4b76fc41ab tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created volume successfully. Sep 18 00:51:25 devstack sudo[105852]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 1073741824" returned: 0 in 0.427s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:25 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 Sep 18 00:51:25 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:25 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.409s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:19Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c95494b1-60bf-4e8a-ab21-47d1666f33bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3ed770dab46f4d02b8620e8c20eaab4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:19Z,use_quota=True,user_id='4808c3805f994d77bb1349fb494ba11c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(1ee4af6f-5d00-4dd5-88eb-8aa39f63e58a),volume_type_id=1ee4af6f-5d00-4dd5-88eb-8aa39f63e58a)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Creating volume c95494b1-60bf-4e8a-ab21-47d1666f33bc {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:25 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d4e6566c-6814-41db-b797-0208fb02fdee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:25 devstack sudo[105861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc 1073741824 Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a8310f-39cc-4314-870f-7b5b04a7b5cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:25 devstack sudo[105861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 (c0a48f89-3b62-44c3-b225-9e13e17ba8c1): created successfully Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9a8310f-39cc-4314-870f-7b5b04a7b5cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (37a91e73-8207-40f6-a4a1-0aa797e916ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ca59e289-29db-4e71-957e-9cdd471f3082 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created volume successfully. Sep 18 00:51:25 devstack sudo[105861]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc 1073741824" returned: 0 in 0.434s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:25 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc Sep 18 00:51:25 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:26 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] <== create_volume: return (727ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.730s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.626s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1049123816',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=446b52d8-ea00-4203-8ddc-c10d6a04a422,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:22Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Creating volume 446b52d8-ea00-4203-8ddc-c10d6a04a422 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:26 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:26 devstack sudo[105869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 1073741824 Sep 18 00:51:26 devstack sudo[105869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Attempting download of caffe6d8-a9c1-4d98-b518-8537cf569e92 ((None, [{'url': 'file:///opt/stack/data/glance/images/caffe6d8-a9c1-4d98-b518-8537cf569e92', 'metadata': {}}])) to volume c95494b1-60bf-4e8a-ab21-47d1666f33bc. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[68a77840-23c0-4090-a4da-c92b953ab145]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_caffe6d8-a9c1-4d98-b518-8537cf569e92_rpyuyy43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:26 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_caffe6d8-a9c1-4d98-b518-8537cf569e92_rpyuyy43 Sep 18 00:51:26 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:26 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_caffe6d8-a9c1-4d98-b518-8537cf569e92_rpyuyy43" returned: 0 in 0.391s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caffe6d8-a9c1-4d98-b518-8537cf569e92_rpyuyy43 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:26 devstack sudo[105869]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 1073741824" returned: 0 in 0.490s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:26 devstack sudo[105880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 Sep 18 00:51:26 devstack sudo[105880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:26 devstack sudo[105879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caffe6d8-a9c1-4d98-b518-8537cf569e92_rpyuyy43 Sep 18 00:51:26 devstack sudo[105879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:26 devstack sudo[105880]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.802s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.161s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2003860619',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d018bd2-f835-4705-8750-10a14d2a9f0d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='69347bf55e3f4b99bdfdcdb663a9dc24',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='022a4f47ccdd4d389c9969792bb4c625',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Creating volume 6d018bd2-f835-4705-8750-10a14d2a9f0d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:26 devstack sudo[105879]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:26 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caffe6d8-a9c1-4d98-b518-8537cf569e92_rpyuyy43" returned: 1 in 0.352s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_caffe6d8-a9c1-4d98-b518-8537cf569e92_rpyuyy43' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a090ecc5-6304-4956-9f34-81f244467f94]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:26 devstack sudo[105886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d 1073741824 Sep 18 00:51:26 devstack sudo[105886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e665cd84-c73f-4a94-a1c5-b56a9199c476) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-446b52d8-ea00-4203-8ddc-c10d6a04a422', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d196646-6d9b-430c-8111-7964ab82f052) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:26 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 (446b52d8-ea00-4203-8ddc-c10d6a04a422): created successfully Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d196646-6d9b-430c-8111-7964ab82f052) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (a192979c-a7c2-4e7a-8858-172027fcc37b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b32851a2-98ac-4379-b950-556d5689cc46 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created volume successfully. Sep 18 00:51:27 devstack sudo[105888]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD Sep 18 00:51:27 devstack sudo[105888]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:27 devstack sudo[105888]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD" returned: 0 in 0.346s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:27 devstack sudo[105886]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d 1073741824" returned: 0 in 0.456s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:27 devstack sudo[105895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD Sep 18 00:51:27 devstack sudo[105895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:27 devstack sudo[105897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d Sep 18 00:51:27 devstack sudo[105897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:27 devstack sudo[105895]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD" returned: 1 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] caffe6d8-a9c1-4d98-b518-8537cf569e92 was raw, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:27 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc Sep 18 00:51:27 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:27 devstack sudo[105897]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.848s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-998578597',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d20e846f-0dd4-416e-8c64-2c917740e036,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Creating volume d20e846f-0dd4-416e-8c64-2c917740e036 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:27 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa7d91f3-55eb-47f4-8294-e5d8140187d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d018bd2-f835-4705-8750-10a14d2a9f0d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:27 devstack sudo[105905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 1073741824 Sep 18 00:51:27 devstack sudo[105905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a595b45a-dcd9-44f4-a660-b5c51161bbde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:27 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Volume volume-6d018bd2-f835-4705-8750-10a14d2a9f0d (6d018bd2-f835-4705-8750-10a14d2a9f0d): created successfully Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a595b45a-dcd9-44f4-a660-b5c51161bbde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:27 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Flow 'volume_create_manager' (e4138686-aa0e-4448-a078-3b5391fa980b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b5976b51-6499-4268-97c0-ddb22576b6f4 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created volume successfully. Sep 18 00:51:28 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc" returned: 0 in 0.471s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_caffe6d8-a9c1-4d98-b518-8537cf569e92_pzaagaoadevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:51:28 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:28 devstack sudo[105914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc 1G Sep 18 00:51:28 devstack sudo[105914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:28 devstack sudo[105905]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 1073741824" returned: 0 in 0.462s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:28 devstack sudo[105916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 Sep 18 00:51:28 devstack sudo[105916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:28 devstack sudo[105916]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 5.435s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-396351635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7544db1-0aeb-4a83-a809-75ad1c9baf61,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Creating volume d7544db1-0aeb-4a83-a809-75ad1c9baf61 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:28 devstack sudo[105914]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:28 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc 1G" returned: 0 in 0.366s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Downloaded image caffe6d8-a9c1-4d98-b518-8537cf569e92 ((None, [{'url': 'file:///opt/stack/data/glance/images/caffe6d8-a9c1-4d98-b518-8537cf569e92', 'metadata': {}}])) to volume c95494b1-60bf-4e8a-ab21-47d1666f33bc successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Temporary image caffe6d8-a9c1-4d98-b518-8537cf569e92 for user 4808c3805f994d77bb1349fb494ba11c is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Marking volume c95494b1-60bf-4e8a-ab21-47d1666f33bc as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:51:28 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 1073741824 Sep 18 00:51:28 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9d8b9925-0d8a-4c47-ae72-86c6a9d55b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d20e846f-0dd4-416e-8c64-2c917740e036', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68672782-255f-4025-9e88-04a2b1c21481) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Copying metadata from image caffe6d8-a9c1-4d98-b518-8537cf569e92 to c95494b1-60bf-4e8a-ab21-47d1666f33bc. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Creating volume glance metadata for volume c95494b1-60bf-4e8a-ab21-47d1666f33bc backed by image caffe6d8-a9c1-4d98-b518-8537cf569e92 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'caffe6d8-a9c1-4d98-b518-8537cf569e92', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '0c9382c24ed5b196543ce4a9f22136a1', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:51:28 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume volume-d20e846f-0dd4-416e-8c64-2c917740e036 (d20e846f-0dd4-416e-8c64-2c917740e036): created successfully Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68672782-255f-4025-9e88-04a2b1c21481) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (371997bd-6d09-4c8d-a907-72b73acb2066) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-79315198-088e-48e0-ad5a-d52dc845eca8 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created volume successfully. Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (261b5e33-2c20-42b2-bc47-30ad2e5ab77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc', 'volume_size': 1, 'image_id': 'caffe6d8-a9c1-4d98-b518-8537cf569e92', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/caffe6d8-a9c1-4d98-b518-8537cf569e92', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '0c9382c24ed5b196543ce4a9f22136a1', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '3ed770dab46f4d02b8620e8c20eaab4f', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c0b3d74be3eb6d7a17f5763a0bd8f5d798218394d745ac5700950fd50e03f25e421d8fb3671aa437665e9a99bcec8aec33c2af633068bc3dba00e946d8f93dd4', 'id': 'caffe6d8-a9c1-4d98-b518-8537cf569e92', 'created_at': datetime.datetime(2026, 9, 17, 22, 51, 17, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 51, 19, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/caffe6d8-a9c1-4d98-b518-8537cf569e92/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621c6c40-8bca-476d-ab50-8e9ad033fa13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-6d018bd2-f835-4705-8750-10a14d2a9f0d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:28 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Volume volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc (c95494b1-60bf-4e8a-ab21-47d1666f33bc): created successfully Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (621c6c40-8bca-476d-ab50-8e9ad033fa13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Flow 'volume_create_manager' (772af212-0500-4b86-99f3-8b8ac98375f7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-6d018bd2-f835-4705-8750-10a14d2a9f0d-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:28 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-41f76a99-a723-43a3-95ae-9b14048ccdb2 tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Created volume successfully. Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-quobyte-6d018bd2-f835-4705-8750-10a14d2a9f0d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-6d018bd2-f835-4705-8750-10a14d2a9f0d" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9704a09b-d1f6-4b30-9fd1-d3a417bb0e84]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:28 devstack sudo[105927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d Sep 18 00:51:28 devstack sudo[105927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:28 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 1073741824" returned: 0 in 0.457s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:29 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 Sep 18 00:51:29 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:29 devstack sudo[105927]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:29 devstack sudo[105935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d Sep 18 00:51:29 devstack sudo[105935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:29 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.846s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9aaaf61d-a920-418c-8f29-5a526ad4f618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9157ad3-a953-4936-b9e0-b46aba728554) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Creating offline snapshot f95ad034-7bea-4294-a633-eaa59de6c209 of volume f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:51:29 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 (d7544db1-0aeb-4a83-a809-75ad1c9baf61): created successfully Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9157ad3-a953-4936-b9e0-b46aba728554) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (a45b45a7-6216-4234-8be6-d129cc14d556) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fea7d83c-0fe7-4737-9ab5-1a956f559a2a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3952e490-40c9-45e0-9deb-f6f9942f599d tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created volume successfully. Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Acquiring lock "cinder-c95494b1-60bf-4e8a-ab21-47d1666f33bc-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "cinder-c95494b1-60bf-4e8a-ab21-47d1666f33bc-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:29 devstack sudo[105935]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6d018bd2-f835-4705-8750-10a14d2a9f0d" returned: 0 in 0.308s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Acquiring lock "cinder-quobyte-c95494b1-60bf-4e8a-ab21-47d1666f33bc" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:29 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-6d018bd2-f835-4705-8750-10a14d2a9f0d" released by "delete_volume" :: held 0.722s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:29 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "cinder-quobyte-c95494b1-60bf-4e8a-ab21-47d1666f33bc" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf1c2842-e77f-4134-8e90-3c36a364da00]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created reservations ['cec93af6-a79c-42e1-a8cc-0b33c4e13267', '7b2d8ac5-b23b-4e73-9b5a-8566874655e6', 'cc77a421-d8a1-49b6-b70d-652c32878282', '5c48bf19-d38d-449e-9aec-a56e74a74b5b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:29 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc Sep 18 00:51:29 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:29 devstack sudo[105943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:29 devstack sudo[105943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:29 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb" returned: 0 in 0.430s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:29 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 1G Sep 18 00:51:29 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-c0a48f89-3b62-44c3-b225-9e13e17ba8c1-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-c0a48f89-3b62-44c3-b225-9e13e17ba8c1-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:29 devstack sudo[105943]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.317s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-quobyte-c0a48f89-3b62-44c3-b225-9e13e17ba8c1" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Deleted volume successfully. Sep 18 00:51:29 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-c0a48f89-3b62-44c3-b225-9e13e17ba8c1" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b42b1169-7f3d-457c-8f8e-f4dc5ba6b34d tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-6d018bd2-f835-4705-8750-10a14d2a9f0d-delete_volume" released by "delete_volume" :: held 1.310s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc" returned: 0 in 0.491s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b598372-9277-4d93-9f48-c10025d94fb8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:30 devstack sudo[105956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc Sep 18 00:51:30 devstack sudo[105956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:30 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 Sep 18 00:51:30 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:30 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 1G" returned: 0 in 0.557s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7136591-8b12-4a8a-be59-a884d177d5eb -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:30 devstack sudo[105956]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c95494b1-60bf-4e8a-ab21-47d1666f33bc" returned: 0 in 0.333s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:30 devstack sudo[105965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7136591-8b12-4a8a-be59-a884d177d5eb -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 Sep 18 00:51:30 devstack sudo[105965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "cinder-quobyte-c95494b1-60bf-4e8a-ab21-47d1666f33bc" released by "delete_volume" :: held 0.882s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Created reservations ['6d44fd99-d28b-4c28-b525-ab13f01721bc', '235c1d4b-840e-450b-b74e-7401d1683461', '67e54b20-f0e1-4f0e-bb23-82c859ce61a8', 'c59ed9a8-4565-423c-a972-ebe82b725cb1'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:30 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:30 devstack sudo[105970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1 Sep 18 00:51:30 devstack sudo[105970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:30 devstack sudo[105972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:30 devstack sudo[105972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:30 devstack sudo[105965]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f7136591-8b12-4a8a-be59-a884d177d5eb -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209" returned: 0 in 0.379s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:30 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 is being set with open permissions: ugo+rw Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:30 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 Sep 18 00:51:30 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:30 devstack sudo[105970]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c0a48f89-3b62-44c3-b225-9e13e17ba8c1" returned: 0 in 0.355s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-c0a48f89-3b62-44c3-b225-9e13e17ba8c1" released by "delete_volume" :: held 0.848s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created reservations ['f154606c-6a39-488e-9e86-fe9d7dddf35b', 'd7f6f897-8bb1-4d1d-a6ea-0587e71f1a50', 'e46a5df0-51f2-4102-8a8d-9647a12348fe', '0919d6e0-1574-4376-b065-5326751c1e15'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:30 devstack sudo[105972]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.376s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:30 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Deleted volume successfully. Sep 18 00:51:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5ee51ffe-86eb-427b-a683-6798124330da tempest-VolumeAndVolumeTypeFromImageTest-955509550 None] Lock "cinder-c95494b1-60bf-4e8a-ab21-47d1666f33bc-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:31 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209" returned: 0 in 0.351s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:31 devstack sudo[105983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:31 devstack sudo[105983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-2f783915-8f99-4aea-a574-f115867f672d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-2f783915-8f99-4aea-a574-f115867f672d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:31 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.info Sep 18 00:51:31 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-quobyte-2f783915-8f99-4aea-a574-f115867f672d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-2f783915-8f99-4aea-a574-f115867f672d" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a58dceb4-7630-43d3-9c04-b8020c850ba6]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:31 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d Sep 18 00:51:31 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:31 devstack sudo[105983]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:31 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.421s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.info" returned: 0 in 0.335s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:31 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.info is being set with open permissions: ugo+rw Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Deleted volume successfully. Sep 18 00:51:31 devstack sudo[105992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.info Sep 18 00:51:31 devstack sudo[105992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f5333fcb-3bd8-4df7-bf83-1a2418bb92c6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-c0a48f89-3b62-44c3-b225-9e13e17ba8c1-delete_volume" released by "delete_volume" :: held 1.628s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:31 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d" returned: 0 in 0.469s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:31 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d Sep 18 00:51:31 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:31 devstack sudo[105992]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.info" returned: 0 in 0.323s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.539s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.284s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-945682115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b3100c4-0a06-4187-8149-8a1a4441aeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:23Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Creating volume 0b3100c4-0a06-4187-8149-8a1a4441aeda {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:31 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:31 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda 1073741824 Sep 18 00:51:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-78b3dd7e-29e9-4e23-8217-08d90fe3f85f tempest-CinderUnicodeTest-1546026564 None] Create snapshot completed successfully Sep 18 00:51:31 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:32 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-2f783915-8f99-4aea-a574-f115867f672d" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-2f783915-8f99-4aea-a574-f115867f672d" released by "delete_volume" :: held 0.821s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created reservations ['78c67867-b880-4c04-a562-9846753d9787', 'a9c51753-bdf6-4b34-b78f-09ee1361564f', '57fb98c4-7e7b-4c36-a0b6-2f5177e30c7e', 'c7f577bf-84cb-443b-a8f6-30dd0ec9d215'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:32 devstack sudo[106006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:32 devstack sudo[106006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-515aab2e-eb11-4815-a9cf-e68f9acb4f09-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-515aab2e-eb11-4815-a9cf-e68f9acb4f09-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-quobyte-515aab2e-eb11-4815-a9cf-e68f9acb4f09" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-515aab2e-eb11-4815-a9cf-e68f9acb4f09" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:32 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda 1073741824" returned: 0 in 0.617s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[56fa93de-c40f-4689-be52-b00ffcce3e4c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:32 devstack sudo[106010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda Sep 18 00:51:32 devstack sudo[106010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:32 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 Sep 18 00:51:32 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:32 devstack sudo[106006]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.404s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Deleted volume successfully. Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-bbda928c-8734-47f9-a034-337bd1594bc2 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-2f783915-8f99-4aea-a574-f115867f672d-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:32 devstack sudo[106010]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "cinder-f95ad034-7bea-4294-a633-eaa59de6c209-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda" returned: 0 in 0.334s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.083s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-321120244',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79a2ebfe-e5b3-420d-92ff-f8816e870838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c0676e52bb384409b80831c71c47a63a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:24Z,use_quota=True,user_id='58f73988034c4b0db1f4f4545ad0d7ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Creating volume 79a2ebfe-e5b3-420d-92ff-f8816e870838 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:32 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b633a7be-ecfc-4a63-a895-7181008ead67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b3100c4-0a06-4187-8149-8a1a4441aeda', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:32 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 1073741824 Sep 18 00:51:32 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e48692-9126-4666-a03b-31038636edf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-f95ad034-7bea-4294-a633-eaa59de6c209-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "cinder-quobyte-f7136591-8b12-4a8a-be59-a884d177d5eb" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume volume-0b3100c4-0a06-4187-8149-8a1a4441aeda (0b3100c4-0a06-4187-8149-8a1a4441aeda): created successfully Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80e48692-9126-4666-a03b-31038636edf0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (8b3a6ad6-320d-4055-a025-2f70ec87c410) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-f7136591-8b12-4a8a-be59-a884d177d5eb" acquired by "delete_snapshot" :: waited 0.056s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "cinder-quobyte-f95ad034-7bea-4294-a633-eaa59de6c209" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:33 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09" returned: 0 in 0.553s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-f95ad034-7bea-4294-a633-eaa59de6c209" acquired by "_delete_snapshot" :: waited 0.060s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Deleting offline snapshot f95ad034-7bea-4294-a633-eaa59de6c209 of volume f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:51:33 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09 Sep 18 00:51:33 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] snapshot_file for this snap is: volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:51:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5a9e47a6-b808-4e17-9d3f-bc789bbac3f0 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created volume successfully. Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f94ded5-bc9f-4e92-beb2-81e48e66233f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:33 devstack sudo[106022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 Sep 18 00:51:33 devstack sudo[106022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:33 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-515aab2e-eb11-4815-a9cf-e68f9acb4f09" returned: 0 in 0.333s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-515aab2e-eb11-4815-a9cf-e68f9acb4f09" released by "delete_volume" :: held 0.943s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:33 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 1073741824" returned: 0 in 0.547s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created reservations ['d66d887e-2bd8-43bf-953e-2d3205934171', '4a644988-7d6a-4d05-8c9f-8bc3d8bb8b6c', '8930172d-3dd0-49ba-b8a9-bbeb877ee3dd', '3b824fc1-5d54-4d8c-b2b3-8786df157d9f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:33 devstack sudo[106029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 Sep 18 00:51:33 devstack sudo[106029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:33 devstack sudo[106022]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209" returned: 0 in 0.580s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f7136591-8b12-4a8a-be59-a884d177d5eb(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:51:33 devstack sudo[106034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:33 devstack sudo[106034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd609f8b-37ad-44ed-8bff-66dc77b32a51]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:33 devstack sudo[106029]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838" returned: 0 in 0.364s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] <== create_volume: return (975ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e33decc-0b86-499c-bc54-aa4f15b4cf12) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79a2ebfe-e5b3-420d-92ff-f8816e870838', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f63a6b-5852-4d05-a7d8-64667e2d3e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:33 devstack sudo[106036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb Sep 18 00:51:33 devstack sudo[106036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Volume volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 (79a2ebfe-e5b3-420d-92ff-f8816e870838): created successfully Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7f63a6b-5852-4d05-a7d8-64667e2d3e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Flow 'volume_create_manager' (26c3610b-faf0-4899-89fb-02bd599583f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a8f81760-85dc-4aec-b2b4-2947dc557965 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created volume successfully. Sep 18 00:51:33 devstack sudo[106034]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.316s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:33 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Deleted volume successfully. Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8a856c64-7009-4ef7-82e5-e7ebc93cbe24 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-515aab2e-eb11-4815-a9cf-e68f9acb4f09-delete_volume" released by "delete_volume" :: held 1.674s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:34 devstack sudo[106036]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb" returned: 0 in 0.406s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:34 devstack sudo[106043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 Sep 18 00:51:34 devstack sudo[106043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:34 devstack sudo[106043]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209" returned: 0 in 0.351s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:34 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209 Sep 18 00:51:34 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-cbc703aa-a452-48a0-9745-9174a790589b-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-cbc703aa-a452-48a0-9745-9174a790589b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-quobyte-cbc703aa-a452-48a0-9745-9174a790589b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-cbc703aa-a452-48a0-9745-9174a790589b" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:34 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfab22d-4ad0-4555-b5a9-8ca7f239b4ee]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb.f95ad034-7bea-4294-a633-eaa59de6c209" returned: 0 in 0.306s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-79a2ebfe-e5b3-420d-92ff-f8816e870838-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-f95ad034-7bea-4294-a633-eaa59de6c209" released by "_delete_snapshot" :: held 1.834s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-79a2ebfe-e5b3-420d-92ff-f8816e870838-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-f7136591-8b12-4a8a-be59-a884d177d5eb" released by "delete_snapshot" :: held 1.926s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:34 devstack sudo[106051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b Sep 18 00:51:34 devstack sudo[106051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-79a2ebfe-e5b3-420d-92ff-f8816e870838" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-79a2ebfe-e5b3-420d-92ff-f8816e870838" acquired by "delete_volume" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[803a176a-6134-4442-b3cc-baa8187fd839]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Created reservations ['4b25efb8-4d3e-4f57-abb1-73341796b7c1', '2d99edc4-dbad-4e4e-b787-8d6379ceeff3', '12838348-d71f-459b-8bad-d6110486ee81', '218ea64e-ea7e-4be8-96da-99ee47879a69'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:35 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Delete snapshot completed successfully. Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-be01e453-c5a0-4926-a5c8-49b6237a8a01 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-f95ad034-7bea-4294-a633-eaa59de6c209-delete_snapshot" released by "delete_snapshot" :: held 2.239s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:35 devstack sudo[106053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 Sep 18 00:51:35 devstack sudo[106053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:35 devstack sudo[106051]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b" returned: 0 in 0.438s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:35 devstack sudo[106058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b Sep 18 00:51:35 devstack sudo[106058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:35 devstack sudo[106053]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838" returned: 0 in 0.429s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:35 devstack sudo[106063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838 Sep 18 00:51:35 devstack sudo[106063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:35 devstack sudo[106058]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-cbc703aa-a452-48a0-9745-9174a790589b" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-cbc703aa-a452-48a0-9745-9174a790589b" released by "delete_volume" :: held 0.810s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created reservations ['a4062193-edde-486e-b20a-6d4378e4cba7', 'e39d8056-8f97-4056-a599-65736958eeed', 'cc83480f-2db7-486e-b298-4f0c5dd349fe', 'c4f30464-d7fd-4fe7-84e4-98c5ea96e0e0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:35 devstack sudo[106067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:35 devstack sudo[106067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:35 devstack sudo[106063]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-79a2ebfe-e5b3-420d-92ff-f8816e870838" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-79a2ebfe-e5b3-420d-92ff-f8816e870838" released by "delete_volume" :: held 0.780s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-659b5c10-2f5a-46a7-b96f-802358acddbe-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created reservations ['9b1235ef-0ed8-4cf7-aadb-837262bb99f6', '661e287d-1cdb-4478-b74b-4aca3ec903df', '550c1c36-5113-40f1-82a5-dd72ae5b3dba', '839cb0af-6b8f-41a0-9116-e3b54ae029b0'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-659b5c10-2f5a-46a7-b96f-802358acddbe-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "cinder-quobyte-659b5c10-2f5a-46a7-b96f-802358acddbe" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:35 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-659b5c10-2f5a-46a7-b96f-802358acddbe" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c403d7e2-d9a0-470a-94c0-99c97978882f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:36 devstack sudo[106067]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.387s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Deleted volume successfully. Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-e6993ade-00b8-4693-af93-896fa1b1b906 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-cbc703aa-a452-48a0-9745-9174a790589b-delete_volume" released by "delete_volume" :: held 1.503s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:36 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:36 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-0b3100c4-0a06-4187-8149-8a1a4441aeda-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-0b3100c4-0a06-4187-8149-8a1a4441aeda-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:36 devstack sudo[106071]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:36 devstack sudo[106071]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (aaa086ab-3ec1-4e0f-9bb6-347a76999d3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447eba68-f983-4dc4-a6df-4eae5eace790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "cinder-f7136591-8b12-4a8a-be59-a884d177d5eb-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (447eba68-f983-4dc4-a6df-4eae5eace790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292374577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395d690e-23b8-4fd9-b4dc-f74dcc143647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:36Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26eceee1-2b6b-4c00-9fff-4d3524b3f359) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (26eceee1-2b6b-4c00-9fff-4d3524b3f359) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3ae892-16aa-4a57-a18b-a857fb536180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f3ae892-16aa-4a57-a18b-a857fb536180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '395d690e-23b8-4fd9-b4dc-f74dcc143647', 'volume_name': 'volume-395d690e-23b8-4fd9-b4dc-f74dcc143647', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc47db15-fc3c-4749-b071-e3ad4a1e832e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dc47db15-fc3c-4749-b071-e3ad4a1e832e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5034a2-c8e2-4058-b508-ef052f64a2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:36 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Volume 395d690e-23b8-4fd9-b4dc-f74dcc143647: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-395d690e-23b8-4fd9-b4dc-f74dcc143647', 'volume_size': 1} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1292374577',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=395d690e-23b8-4fd9-b4dc-f74dcc143647,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:36Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Creating volume 395d690e-23b8-4fd9-b4dc-f74dcc143647 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:36 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-f7136591-8b12-4a8a-be59-a884d177d5eb-delete_volume" acquired by "delete_volume" :: waited 0.147s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-0b3100c4-0a06-4187-8149-8a1a4441aeda" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:36 devstack sudo[106075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 1073741824 Sep 18 00:51:36 devstack sudo[106075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-0b3100c4-0a06-4187-8149-8a1a4441aeda" acquired by "delete_volume" :: waited 0.039s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffcfb4c6-a274-4d18-9361-f836ba90f514]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:36 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.465s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Deleted volume successfully. Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "cinder-quobyte-f7136591-8b12-4a8a-be59-a884d177d5eb" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-3aaf5fa7-ce14-4615-b880-ae87022a68da tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-79a2ebfe-e5b3-420d-92ff-f8816e870838-delete_volume" released by "delete_volume" :: held 1.750s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-f7136591-8b12-4a8a-be59-a884d177d5eb" acquired by "delete_volume" :: waited 0.055s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b06645d-9323-4426-a711-db1e828527a9]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:36 devstack sudo[106078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda Sep 18 00:51:36 devstack sudo[106078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:36 devstack sudo[106071]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe" returned: 0 in 0.752s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:36 devstack sudo[106087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe Sep 18 00:51:36 devstack sudo[106087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:36 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb Sep 18 00:51:36 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (7bad6c0c-f944-483e-85e4-379cec901c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a195d009-bb22-40c2-a11a-d2b610b0db50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:36 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a195d009-bb22-40c2-a11a-d2b610b0db50) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694243900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0fe5f00-0c5e-4052-8117-20440c4a469d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:37Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96d121-19cd-4bf3-bf48-cc61d3f74994) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a96d121-19cd-4bf3-bf48-cc61d3f74994) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d897e34-4d7e-40fe-8abd-08b76478c3c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7d897e34-4d7e-40fe-8abd-08b76478c3c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0fe5f00-0c5e-4052-8117-20440c4a469d', 'volume_name': 'volume-d0fe5f00-0c5e-4052-8117-20440c4a469d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4e2e62-0774-4d5d-80b7-33dd34731297) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a4e2e62-0774-4d5d-80b7-33dd34731297) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bf2d50-f72e-4841-b561-0d3d71e50689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Volume d0fe5f00-0c5e-4052-8117-20440c4a469d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0fe5f00-0c5e-4052-8117-20440c4a469d', 'volume_size': 1} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:37 devstack sudo[106075]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 1073741824" returned: 0 in 0.779s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:37 devstack sudo[106087]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-659b5c10-2f5a-46a7-b96f-802358acddbe" returned: 0 in 0.462s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:37 devstack sudo[106078]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:37 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda" returned: 0 in 0.719s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:37 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 Sep 18 00:51:37 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-quobyte-659b5c10-2f5a-46a7-b96f-802358acddbe" released by "delete_volume" :: held 1.330s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb" returned: 0 in 0.579s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:37 devstack sudo[106100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda Sep 18 00:51:37 devstack sudo[106100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:37 devstack sudo[106102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb Sep 18 00:51:37 devstack sudo[106102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Created reservations ['3d25fd1c-05a4-40cf-9d33-539c6c46cd3e', '7a359989-a0c3-4623-b494-c516907676a5', '6fe60ee5-00c0-4a55-9e2d-630117e272a2', '346cfd8f-04f7-427d-bfc2-b2d0b32c6938'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:37 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647" returned: 0 in 0.372s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.230s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.524s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1694243900',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0fe5f00-0c5e-4052-8117-20440c4a469d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:37Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Creating volume d0fe5f00-0c5e-4052-8117-20440c4a469d {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:37 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:37 devstack sudo[106100]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:37 devstack sudo[106106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d 1073741824 Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:37 devstack sudo[106106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:37 devstack sudo[106102]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:37 devstack sudo[106109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:37 devstack sudo[106109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (90252138-5dd0-4965-a780-aed2993d722f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9e327a-b7ff-4fa6-b12b-1d852533da2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-0b3100c4-0a06-4187-8149-8a1a4441aeda" returned: 0 in 0.491s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f7136591-8b12-4a8a-be59-a884d177d5eb" returned: 0 in 0.479s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d5034a2-c8e2-4058-b508-ef052f64a2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-395d690e-23b8-4fd9-b4dc-f74dcc143647', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fca7aa-6a30-4062-acdb-c4f11d58e4ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9e327a-b7ff-4fa6-b12b-1d852533da2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155858333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636932c5-6a2e-4950-86d1-b4bb2a60b5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:37Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3cf2f3-2a40-424a-9748-9ec914242d49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d3cf2f3-2a40-424a-9748-9ec914242d49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f813153-49e8-45a2-98cd-d348ab8767b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4f813153-49e8-45a2-98cd-d348ab8767b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '636932c5-6a2e-4950-86d1-b4bb2a60b5b2', 'volume_name': 'volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c46b4e-afbe-4eec-8915-5dedf33f75eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81c46b4e-afbe-4eec-8915-5dedf33f75eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9ef592-4513-4dcf-af58-8c7a102d0f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Volume 636932c5-6a2e-4950-86d1-b4bb2a60b5b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2', 'volume_size': 1} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-f7136591-8b12-4a8a-be59-a884d177d5eb" released by "delete_volume" :: held 1.203s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-0b3100c4-0a06-4187-8149-8a1a4441aeda" released by "delete_volume" :: held 1.378s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Volume volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 (395d690e-23b8-4fd9-b4dc-f74dcc143647): created successfully Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (68fca7aa-6a30-4062-acdb-c4f11d58e4ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (aaa086ab-3ec1-4e0f-9bb6-347a76999d3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0071c2e3-2ad3-4b8e-a8ba-49824d02ce19 tempest-CreateVolumesFromImageTest-1990840260 None] Created volume successfully. Sep 18 00:51:37 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Created reservations ['955ef63d-f824-460b-82c1-a20e52942704', '5534fb93-2a13-45d0-9810-2409cc849615', '4463e1f9-cedc-45bf-9fed-6e153d888c33', '5c0f7826-e71f-4127-9b5f-b67e679275b5'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created reservations ['0d132ae7-dfe8-4bbc-88d9-b67bbba88c7c', '4d81c474-03a7-470f-932b-b399e538c199', 'b9eeba99-0391-4830-8395-4c5d7d655244', 'a3f6f4fd-3dea-4a46-b3ed-7bfce30e71cb'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:38 devstack sudo[106109]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.484s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:38 devstack sudo[106116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:38 devstack sudo[106116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Deleted volume successfully. Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b56f26c7-3ecb-4d63-bbb9-b5726c58bea6 tempest-CreateVolumesFromSourceVolumeTest-1252155800 None] Lock "cinder-659b5c10-2f5a-46a7-b96f-802358acddbe-delete_volume" released by "delete_volume" :: held 2.390s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:38 devstack sudo[106106]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:38 devstack sudo[106118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:38 devstack sudo[106118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (ae4be8c4-c589-4a1e-bc3c-1783fd294684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce44b9b3-1e44-497c-bdb4-f4489a05c4bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d 1073741824" returned: 0 in 0.699s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce44b9b3-1e44-497c-bdb4-f4489a05c4bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1371459741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c735302c-7997-43f7-a6d6-92c52491e699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:38Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9310689-24ad-4f03-b9a6-cbc47fb450b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9310689-24ad-4f03-b9a6-cbc47fb450b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5d869c-df6a-4132-be5b-fe2eb6cd2de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df5d869c-df6a-4132-be5b-fe2eb6cd2de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c735302c-7997-43f7-a6d6-92c52491e699', 'volume_name': 'volume-c735302c-7997-43f7-a6d6-92c52491e699', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f267bdeb-20f9-4032-b2c6-041de102ddc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f267bdeb-20f9-4032-b2c6-041de102ddc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1480075e-c53d-464d-8508-bd221ef535fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Volume c735302c-7997-43f7-a6d6-92c52491e699: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c735302c-7997-43f7-a6d6-92c52491e699', 'volume_size': 1} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:38 devstack sudo[106120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d Sep 18 00:51:38 devstack sudo[106120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:38 devstack sudo[106116]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.404s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Deleted volume successfully. Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6c3236a8-4d86-4b3b-ae2f-77c5da41b8e8 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-f7136591-8b12-4a8a-be59-a884d177d5eb-delete_volume" released by "delete_volume" :: held 2.117s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:38 devstack sudo[106118]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.478s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:38 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Deleted volume successfully. Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-d7544db1-0aeb-4a83-a809-75ad1c9baf61-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "cinder-537a6081-baed-4021-8244-ed9767e9e503-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-df65fd70-740c-4a03-a2aa-f8061f764d8a tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-0b3100c4-0a06-4187-8149-8a1a4441aeda-delete_volume" released by "delete_volume" :: held 2.614s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-d7544db1-0aeb-4a83-a809-75ad1c9baf61-delete_volume" acquired by "delete_volume" :: waited 0.098s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:38 devstack sudo[106120]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (30b908a1-9ce8-4c9a-b88b-0d7150295a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e4dd32-fff6-4d58-980a-923684f4c575) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-537a6081-baed-4021-8244-ed9767e9e503-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d" returned: 0 in 0.469s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] <== create_volume: return (1293ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.297s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.049s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155858333',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=636932c5-6a2e-4950-86d1-b4bb2a60b5b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:37Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Creating volume 636932c5-6a2e-4950-86d1-b4bb2a60b5b2 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:38 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (74e4dd32-fff6-4d58-980a-923684f4c575) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-642472234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bb5be1-bd94-4d1b-a486-cf13620b694b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:39Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack sudo[106127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 1073741824 Sep 18 00:51:38 devstack sudo[106127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255ac5f-44ec-4dcc-bd9f-c6d074754a0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a255ac5f-44ec-4dcc-bd9f-c6d074754a0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3110e6-d1c9-409e-a04b-3aa329a2f822) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b3110e6-d1c9-409e-a04b-3aa329a2f822) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bb5be1-bd94-4d1b-a486-cf13620b694b', 'volume_name': 'volume-52bb5be1-bd94-4d1b-a486-cf13620b694b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b94b8f-279c-4cad-9c57-a8024d9fb94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43b94b8f-279c-4cad-9c57-a8024d9fb94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7071f075-db66-4072-a3e5-92d4f9dc62db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:38 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Volume 52bb5be1-bd94-4d1b-a486-cf13620b694b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bb5be1-bd94-4d1b-a486-cf13620b694b', 'volume_size': 1} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:38 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7bf2d50-f72e-4841-b561-0d3d71e50689) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0fe5f00-0c5e-4052-8117-20440c4a469d', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ddc307-74e1-4bcb-9f73-92b1877fe0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-d7544db1-0aeb-4a83-a809-75ad1c9baf61" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:39 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Volume volume-d0fe5f00-0c5e-4052-8117-20440c4a469d (d0fe5f00-0c5e-4052-8117-20440c4a469d): created successfully Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4ddc307-74e1-4bcb-9f73-92b1877fe0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (7bad6c0c-f944-483e-85e4-379cec901c0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "cinder-quobyte-537a6081-baed-4021-8244-ed9767e9e503" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5adb7cb8-1664-482d-8c58-afff2ef954eb tempest-CreateVolumesFromImageTest-1990840260 None] Created volume successfully. Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-d7544db1-0aeb-4a83-a809-75ad1c9baf61" acquired by "delete_volume" :: waited 0.054s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-537a6081-baed-4021-8244-ed9767e9e503" acquired by "delete_volume" :: waited 0.062s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c5b87c-b9f5-4a7f-8ac1-dc76cf3967ee]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f5164ddf-d39e-4db8-882d-f5b5f79fa68f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:39 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 Sep 18 00:51:39 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:39 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 Sep 18 00:51:39 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:39 devstack sudo[106127]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 1073741824" returned: 0 in 0.619s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:39 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61" returned: 0 in 0.476s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:39 devstack sudo[106142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 Sep 18 00:51:39 devstack sudo[106142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:39 devstack sudo[106143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61 Sep 18 00:51:39 devstack sudo[106143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:39 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503" returned: 0 in 0.563s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:39 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503 Sep 18 00:51:39 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:39 devstack sudo[106143]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d7544db1-0aeb-4a83-a809-75ad1c9baf61" returned: 0 in 0.326s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-d7544db1-0aeb-4a83-a809-75ad1c9baf61" released by "delete_volume" :: held 0.891s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:39 devstack sudo[106142]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2" returned: 0 in 0.388s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.604s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1371459741',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c735302c-7997-43f7-a6d6-92c52491e699,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:38Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Creating volume c735302c-7997-43f7-a6d6-92c52491e699 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:39 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:39 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:40 devstack sudo[106152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 1073741824 Sep 18 00:51:40 devstack sudo[106152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e9ef592-4513-4dcf-af58-8c7a102d0f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a666da1-a845-41bf-803e-c5a4b6789016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:40 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Volume volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 (636932c5-6a2e-4950-86d1-b4bb2a60b5b2): created successfully Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a666da1-a845-41bf-803e-c5a4b6789016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (90252138-5dd0-4965-a780-aed2993d722f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:40 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-537a6081-baed-4021-8244-ed9767e9e503" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-37837b66-27bb-4f6a-b09c-8382b98e3df2 tempest-CreateVolumesFromImageTest-1990840260 None] Created volume successfully. Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-quobyte-537a6081-baed-4021-8244-ed9767e9e503" released by "delete_volume" :: held 1.009s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created reservations ['2b41b4a2-ba76-4025-b757-9a1590d73e09', '88360faa-9313-4af8-ab1a-28f797c35180', 'ca8a6bf0-8924-434e-95b6-20cd21d7c257', '4b8b1580-3bae-4dd9-9d01-58db2b49363f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Created reservations ['09858bc9-c784-40ae-a9bd-de412247aa8f', '731e6549-61a0-4bc6-93d7-8bd7efe46c14', '51f0d67e-800e-48c6-b834-4400587940d5', '70716da3-1268-4a1d-af69-0f11fad0a420'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:40 devstack sudo[106155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:40 devstack sudo[106155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:40 devstack sudo[106160]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:40 devstack sudo[106160]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:40 devstack sudo[106152]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 1073741824" returned: 0 in 0.562s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:40 devstack sudo[106155]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.352s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:40 devstack sudo[106160]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.282s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Deleted volume successfully. Sep 18 00:51:40 devstack sudo[106165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 Sep 18 00:51:40 devstack sudo[106165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5f672c78-c99e-4b05-97ef-831b4ebff208 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-d7544db1-0aeb-4a83-a809-75ad1c9baf61-delete_volume" released by "delete_volume" :: held 1.803s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Deleted volume successfully. Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-97199fb4-363b-491f-a42e-c15192ae9ba4 tempest-CinderUnicodeTest-1546026564 None] Lock "cinder-537a6081-baed-4021-8244-ed9767e9e503-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:40 devstack sudo[106165]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699" returned: 0 in 0.296s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.917s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-642472234',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bb5be1-bd94-4d1b-a486-cf13620b694b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de762261518f473dbbf4ee9a04e5d922',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:39Z,use_quota=True,user_id='597f3d153dd74965b6806bbef39a7b81',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Creating volume 52bb5be1-bd94-4d1b-a486-cf13620b694b {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:40 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1480075e-c53d-464d-8508-bd221ef535fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c735302c-7997-43f7-a6d6-92c52491e699', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:40 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b 1073741824 Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4716e13b-fa6b-494d-963e-2a86e4bf340b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:40 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:40 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Volume volume-c735302c-7997-43f7-a6d6-92c52491e699 (c735302c-7997-43f7-a6d6-92c52491e699): created successfully Sep 18 00:51:40 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4716e13b-fa6b-494d-963e-2a86e4bf340b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (ae4be8c4-c589-4a1e-bc3c-1783fd294684) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a2bd0124-915c-4f35-9e23-e5c380eb56be tempest-CreateVolumesFromImageTest-1990840260 None] Created volume successfully. Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-d20e846f-0dd4-416e-8c64-2c917740e036-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-d20e846f-0dd4-416e-8c64-2c917740e036-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-d20e846f-0dd4-416e-8c64-2c917740e036" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-d20e846f-0dd4-416e-8c64-2c917740e036" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a516e5-1844-4e9d-bbd9-056685d32087]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:41 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 Sep 18 00:51:41 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:41 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b 1073741824" returned: 0 in 0.636s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:41 devstack sudo[106177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b Sep 18 00:51:41 devstack sudo[106177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:41 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036" returned: 0 in 0.503s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:41 devstack sudo[106182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036 Sep 18 00:51:41 devstack sudo[106182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:41 devstack sudo[106177]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b" returned: 0 in 0.289s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7071f075-db66-4072-a3e5-92d4f9dc62db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bb5be1-bd94-4d1b-a486-cf13620b694b', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b952dc-ae4e-4efb-9d7d-7d7b16d3e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:41 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Volume volume-52bb5be1-bd94-4d1b-a486-cf13620b694b (52bb5be1-bd94-4d1b-a486-cf13620b694b): created successfully Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7b952dc-ae4e-4efb-9d7d-7d7b16d3e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Flow 'volume_create_manager' (30b908a1-9ce8-4c9a-b88b-0d7150295a92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:41 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cef6551f-f9be-48f0-bbfd-3c411071a49a tempest-CreateVolumesFromImageTest-1990840260 None] Created volume successfully. Sep 18 00:51:42 devstack sudo[106182]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d20e846f-0dd4-416e-8c64-2c917740e036" returned: 0 in 0.335s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-d20e846f-0dd4-416e-8c64-2c917740e036" released by "delete_volume" :: held 0.902s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created reservations ['16661771-cdd0-4906-a6e3-824ad2ec3863', '0086dc38-a6dc-4c6f-8729-ad89fb6c88da', '32957e2b-e221-44e9-936f-734c53a01f90', 'e1db7f9f-ec6c-4496-8941-5b4030a4475b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-52bb5be1-bd94-4d1b-a486-cf13620b694b-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:42 devstack sudo[106186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:42 devstack sudo[106186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-52bb5be1-bd94-4d1b-a486-cf13620b694b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-quobyte-52bb5be1-bd94-4d1b-a486-cf13620b694b" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-52bb5be1-bd94-4d1b-a486-cf13620b694b" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[abce4c2c-c059-46ad-892a-39883e065e63]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:42 devstack sudo[106186]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:42 devstack sudo[106188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.304s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:42 devstack sudo[106188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Deleted volume successfully. Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-938df3a7-8e54-427c-8601-9ccfda83b2ad tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-d20e846f-0dd4-416e-8c64-2c917740e036-delete_volume" released by "delete_volume" :: held 1.521s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:42 devstack sudo[106188]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b" returned: 0 in 0.480s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:42 devstack sudo[106194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b Sep 18 00:51:42 devstack sudo[106194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:43 devstack sudo[106194]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-52bb5be1-bd94-4d1b-a486-cf13620b694b" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-52bb5be1-bd94-4d1b-a486-cf13620b694b" released by "delete_volume" :: held 0.795s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Created reservations ['cde7a3d5-a288-4cdf-a076-490e2c582871', '15a9e336-c004-413c-8d45-7049aecc466f', '262c66be-4e4f-4c6c-82a5-0851273c4a02', '6c423199-779f-404d-ac6e-846a7c05f91f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:43 devstack sudo[106197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:43 devstack sudo[106197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-446b52d8-ea00-4203-8ddc-c10d6a04a422-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-446b52d8-ea00-4203-8ddc-c10d6a04a422-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-446b52d8-ea00-4203-8ddc-c10d6a04a422" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-446b52d8-ea00-4203-8ddc-c10d6a04a422" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-c735302c-7997-43f7-a6d6-92c52491e699-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[79bea21a-b743-4709-9536-cad2affa6c24]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-c735302c-7997-43f7-a6d6-92c52491e699-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:43 devstack sudo[106197]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.350s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:43 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Deleted volume successfully. Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-quobyte-c735302c-7997-43f7-a6d6-92c52491e699" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-c735302c-7997-43f7-a6d6-92c52491e699" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f45e7683-03ae-41e1-8454-cf03c1ecdba4 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-52bb5be1-bd94-4d1b-a486-cf13620b694b-delete_volume" released by "delete_volume" :: held 1.449s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:43 devstack sudo[106199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 Sep 18 00:51:43 devstack sudo[106199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b31acdf-ce08-4631-8670-8005d45a87fa]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:43 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 Sep 18 00:51:43 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:44 devstack sudo[106199]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422" returned: 0 in 0.501s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:44 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422 Sep 18 00:51:44 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:44 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699" returned: 0 in 0.433s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:44 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699 Sep 18 00:51:44 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:44 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-446b52d8-ea00-4203-8ddc-c10d6a04a422" returned: 0 in 0.333s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-446b52d8-ea00-4203-8ddc-c10d6a04a422" released by "delete_volume" :: held 0.925s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:44 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created reservations ['8fcb1efb-dd19-4f05-a96b-95e49c763bb6', 'b86b8f5d-39ec-426a-b712-24172e0eb3a0', 'eac4603a-bb99-4ab0-8313-8960156ffdbd', 'e5e353e4-6b79-4632-9df8-e5418f76f8b1'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c735302c-7997-43f7-a6d6-92c52491e699" returned: 0 in 0.317s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-c735302c-7997-43f7-a6d6-92c52491e699" released by "delete_volume" :: held 0.828s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Created reservations ['b1de8a1f-7fb7-4ff2-a706-a26fea8c2217', 'e94cf56d-644c-4b98-b732-ad0dcc605a6b', 'fdcd2955-59cc-495e-bad6-45298621faee', '4da14388-c4f3-401f-8bb6-446096665c7f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:44 devstack sudo[106216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:44 devstack sudo[106216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:44 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:44 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:44 devstack sudo[106216]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.348s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Deleted volume successfully. Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1133619d-3235-4890-9442-a6b5db094aaf tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-446b52d8-ea00-4203-8ddc-c10d6a04a422-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:45 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.279s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Deleted volume successfully. Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-84543d40-c37f-4066-bccc-0fdb867eda0d tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-c735302c-7997-43f7-a6d6-92c52491e699-delete_volume" released by "delete_volume" :: held 1.484s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Flow 'volume_create_manager' (4768eb12-2328-4c20-959b-683c3451bbbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85923815-6a1f-4ef4-9194-4f7dae4316fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85923815-6a1f-4ef4-9194-4f7dae4316fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8280cff7-892f-410e-976a-2c5088fa7b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed91b1efdd0545229b4d4a10e96b9fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:46Z,use_quota=True,user_id='87e8b091d9b74d4f8179f286aadad6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4600e2e3-65eb-410d-86cd-facad2f3f738) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4600e2e3-65eb-410d-86cd-facad2f3f738) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42afc4b-e8c3-4469-99ec-470eb731c207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.image.glance [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Creating Keystone auth plugin from conf {{(pid=86526) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-16b16f9a-6a5c-462b-a8ab-2feadf8603a4-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-16b16f9a-6a5c-462b-a8ab-2feadf8603a4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-b29f3d47-1ab1-416c-88a7-d1feb06f480f" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (5f0aaa63-616f-4dd0-9257-929e4de00810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975b9daa-3ac9-4e2d-9e55-08536958ceb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-b29f3d47-1ab1-416c-88a7-d1feb06f480f" acquired by "delete_snapshot" :: waited 0.066s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-16b16f9a-6a5c-462b-a8ab-2feadf8603a4" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (975b9daa-3ac9-4e2d-9e55-08536958ceb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-786622484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f68110-e68e-4db1-bce1-0aecca81b0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:46Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f17e8e3-8b52-4cf6-b870-c40835129ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f17e8e3-8b52-4cf6-b870-c40835129ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e3e5d9-a379-4ab3-b6a2-f44817983c02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3e3e5d9-a379-4ab3-b6a2-f44817983c02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0f68110-e68e-4db1-bce1-0aecca81b0ac', 'volume_name': 'volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf4d26a-72bc-4e4a-93d8-fa5aac2a2f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (adf4d26a-72bc-4e4a-93d8-fa5aac2a2f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d298181b-3cc7-4b17-9640-5175f1dff91f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:45 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Volume e0f68110-e68e-4db1-bce1-0aecca81b0ac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac', 'volume_size': 1} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-786622484',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0f68110-e68e-4db1-bce1-0aecca81b0ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:46Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Creating volume e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:45 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-636932c5-6a2e-4950-86d1-b4bb2a60b5b2-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:45 devstack sudo[106224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac 1073741824 Sep 18 00:51:45 devstack sudo[106224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-16b16f9a-6a5c-462b-a8ab-2feadf8603a4" acquired by "_delete_snapshot" :: waited 0.125s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Deleting offline snapshot 16b16f9a-6a5c-462b-a8ab-2feadf8603a4 of volume b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] snapshot_file for this snap is: volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-636932c5-6a2e-4950-86d1-b4bb2a60b5b2-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c86eb5a-fc75-4681-a390-a54d00b3bbd1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-quobyte-636932c5-6a2e-4950-86d1-b4bb2a60b5b2" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-636932c5-6a2e-4950-86d1-b4bb2a60b5b2" acquired by "delete_volume" :: waited 0.035s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:46 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 Sep 18 00:51:46 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b79f52b2-863f-48da-942a-7dae912ca076]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c42afc4b-e8c3-4469-99ec-470eb731c207) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '8280cff7-892f-410e-976a-2c5088fa7b46', 'volume_name': 'volume-8280cff7-892f-410e-976a-2c5088fa7b46', 'volume_size': 1, 'image_id': '2c86c70a-008b-4b50-a790-fa2bcd646a27', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c86c70a-008b-4b50-a790-fa2bcd646a27', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bdcbcaf0fb7624e4d68a2413421633ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed91b1efdd0545229b4d4a10e96b9fdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dea4716c3b07609b6eff66853602830fa3ed0c245c2717193a041b04c1e90eb7781e0f109e5c9365a56253037f670aed72397993c103c918f4eda719065cf9c1', 'id': '2c86c70a-008b-4b50-a790-fa2bcd646a27', 'created_at': datetime.datetime(2026, 9, 17, 22, 51, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c86c70a-008b-4b50-a790-fa2bcd646a27/file', 'properties': {}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a43456f-59c7-4722-8652-31618a0d3274) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a43456f-59c7-4722-8652-31618a0d3274) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1fcfbb-f1fb-4ee0-9843-55e3fb4c1036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:46 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Volume 8280cff7-892f-410e-976a-2c5088fa7b46: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-8280cff7-892f-410e-976a-2c5088fa7b46', 'volume_size': 1, 'image_id': '2c86c70a-008b-4b50-a790-fa2bcd646a27', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c86c70a-008b-4b50-a790-fa2bcd646a27', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bdcbcaf0fb7624e4d68a2413421633ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed91b1efdd0545229b4d4a10e96b9fdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dea4716c3b07609b6eff66853602830fa3ed0c245c2717193a041b04c1e90eb7781e0f109e5c9365a56253037f670aed72397993c103c918f4eda719065cf9c1', 'id': '2c86c70a-008b-4b50-a790-fa2bcd646a27', 'created_at': datetime.datetime(2026, 9, 17, 22, 51, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c86c70a-008b-4b50-a790-fa2bcd646a27/file', 'properties': {}}, 'image_service': } Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Trying to clone 8280cff7-892f-410e-976a-2c5088fa7b46 from image 2c86c70a-008b-4b50-a790-fa2bcd646a27 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2c86c70a-008b-4b50-a790-fa2bcd646a27', 'metadata': {}}]). {{(pid=86526) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 18 00:51:46 devstack sudo[106230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 Sep 18 00:51:46 devstack sudo[106230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Sep 18 00:51:46 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Image download 0.00 MB at 0.00 MB/s Sep 18 00:51:46 devstack sudo[106224]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:46 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4" returned: 0 in 0.501s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac 1073741824" returned: 0 in 0.628s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[96a28bb3-ba8f-4a30-a17b-74dfa8c24b0d]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f395df-07e8-4228-ab9f-bd31bd0fd562]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:46 devstack sudo[106243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac Sep 18 00:51:46 devstack sudo[106238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD Sep 18 00:51:46 devstack sudo[106238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:46 devstack sudo[106243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:46 devstack sudo[106230]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2" returned: 0 in 0.476s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:46 devstack sudo[106240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f Sep 18 00:51:46 devstack sudo[106240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:46 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2 Sep 18 00:51:46 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:46 devstack sudo[106238]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:46 devstack sudo[106243]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac" returned: 0 in 0.314s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (1068ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:46 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-636932c5-6a2e-4950-86d1-b4bb2a60b5b2" returned: 0 in 0.272s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-636932c5-6a2e-4950-86d1-b4bb2a60b5b2" released by "delete_volume" :: held 0.813s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d298181b-3cc7-4b17-9640-5175f1dff91f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89daae92-2e3e-4e53-89ca-5677d39edef5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:46 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Volume volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac (e0f68110-e68e-4db1-bce1-0aecca81b0ac): created successfully Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (89daae92-2e3e-4e53-89ca-5677d39edef5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:46 devstack sudo[106240]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (5f0aaa63-616f-4dd0-9257-929e4de00810) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f" returned: 0 in 0.456s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:47 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0a1e7eed-aab7-46f0-83ad-659aa0798b6c tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:51:47 devstack sudo[106255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD Sep 18 00:51:47 devstack sudo[106255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:47 devstack sudo[106257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 Sep 18 00:51:47 devstack sudo[106257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Created reservations ['b759f91c-e778-4f7f-8143-d8fcc82ae447', '3bac5621-af9e-48d3-9450-6dcda74edc02', 'ffc0de7d-db24-42be-91ad-30244f821a72', '8d6ccda9-5657-40f3-b9aa-5ccab67f6a85'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:47 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:47 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:47 devstack sudo[106255]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD" returned: 1 in 0.356s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Temporary image 2c86c70a-008b-4b50-a790-fa2bcd646a27 is fetched for user 87e8b091d9b74d4f8179f286aadad6ac. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[563c69a7-bf58-41e4-b220-d6a35f4a04c0]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:47 devstack sudo[106257]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:47 devstack sudo[106270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4 Sep 18 00:51:47 devstack sudo[106270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:47 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:47 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Deleted volume successfully. Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-93a164ec-0b35-4869-bd2d-0744b16d908e tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-636932c5-6a2e-4950-86d1-b4bb2a60b5b2-delete_volume" released by "delete_volume" :: held 1.488s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:47 devstack sudo[106268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD Sep 18 00:51:47 devstack sudo[106268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:47 devstack sudo[106270]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f.16b16f9a-6a5c-462b-a8ab-2feadf8603a4" returned: 0 in 0.290s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:47 devstack sudo[106268]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-16b16f9a-6a5c-462b-a8ab-2feadf8603a4" released by "_delete_snapshot" :: held 1.812s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-b29f3d47-1ab1-416c-88a7-d1feb06f480f" released by "delete_snapshot" :: held 1.949s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created reservations ['51a35324-31ee-474a-8634-cfa54f9373d5', '5da2bf0d-1d14-4de6-a038-71e76742e57d', 'cbb36e92-2e1e-4250-b3d5-69654511e4f1', '221311aa-0de4-4229-a864-45ea82c5c14e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:47 devstack sudo[106276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD Sep 18 00:51:47 devstack sudo[106276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:47 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Delete snapshot completed successfully. Sep 18 00:51:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ecb19885-98e4-46dc-baba-8a5d76cf9e85 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-16b16f9a-6a5c-462b-a8ab-2feadf8603a4-delete_snapshot" released by "delete_snapshot" :: held 2.150s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot 2db46b12-404a-45ff-867e-d2628bc18d24 of volume e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a23b5-b9e7-44b4-a464-30954b3320e9]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:48 devstack sudo[106276]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD" returned: 1 in 0.351s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:48 devstack sudo[106281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac Sep 18 00:51:48 devstack sudo[106281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-d0fe5f00-0c5e-4052-8117-20440c4a469d-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-d0fe5f00-0c5e-4052-8117-20440c4a469d-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-quobyte-d0fe5f00-0c5e-4052-8117-20440c4a469d" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-d0fe5f00-0c5e-4052-8117-20440c4a469d" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[528d2d1d-3be9-4367-8267-b4712ae9a22f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:48 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d Sep 18 00:51:48 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:48 devstack sudo[106281]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac" returned: 0 in 0.384s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:48 devstack sudo[106288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 1G Sep 18 00:51:48 devstack sudo[106288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:48 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:48 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d Sep 18 00:51:48 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:48 devstack sudo[106288]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 1G" returned: 0 in 0.439s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-b29f3d47-1ab1-416c-88a7-d1feb06f480f-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:48 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 Sep 18 00:51:48 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:48 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d0fe5f00-0c5e-4052-8117-20440c4a469d" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-b29f3d47-1ab1-416c-88a7-d1feb06f480f-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-d0fe5f00-0c5e-4052-8117-20440c4a469d" released by "delete_volume" :: held 0.707s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "cinder-quobyte-b29f3d47-1ab1-416c-88a7-d1feb06f480f" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-b29f3d47-1ab1-416c-88a7-d1feb06f480f" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2b53d12-6319-4af2-8045-a8ae761c393f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Created reservations ['74b2165f-6a9f-405e-a242-b5a67c915b0e', '58a991b5-ebbe-485e-847c-0edc4413f43d', '03fdf79e-c2bc-4b10-a8ba-538318510321', '690ccf9a-fbf1-497a-aaac-fc39ec1d79d4'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack sudo[106301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f Sep 18 00:51:49 devstack sudo[106301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack sudo[106306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:49 devstack sudo[106306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24" returned: 0 in 0.349s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:49 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 is being set with open permissions: ugo+rw Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack sudo[106309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 Sep 18 00:51:49 devstack sudo[106309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-395d690e-23b8-4fd9-b4dc-f74dcc143647-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-395d690e-23b8-4fd9-b4dc-f74dcc143647-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "cinder-quobyte-395d690e-23b8-4fd9-b4dc-f74dcc143647" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-395d690e-23b8-4fd9-b4dc-f74dcc143647" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[80e175c8-cc80-40fe-a956-5a846d18c5fd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack sudo[106306]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.355s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:49 devstack sudo[106301]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Deleted volume successfully. Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f" returned: 0 in 0.464s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack sudo[106317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f Sep 18 00:51:49 devstack sudo[106317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9747fd9f-7e00-41a3-b761-dff13915f956 tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-d0fe5f00-0c5e-4052-8117-20440c4a469d-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:49 devstack sudo[106309]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:49 devstack sudo[106315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 Sep 18 00:51:49 devstack sudo[106315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack sudo[106320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.info Sep 18 00:51:49 devstack sudo[106320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack sudo[106317]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b29f3d47-1ab1-416c-88a7-d1feb06f480f" returned: 0 in 0.272s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-quobyte-b29f3d47-1ab1-416c-88a7-d1feb06f480f" released by "delete_volume" :: held 0.813s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Created reservations ['6f6802ed-452f-4809-876e-0d197f416c68', '735c4e54-fd31-486e-9d6f-c8fb69d396d1', '35ae361e-4c16-4f8d-b20a-ee9bd864e7e7', '8e5da59b-ad8d-47ac-b638-e7c5b1161bfc'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:49 devstack sudo[106315]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647" returned: 0 in 0.410s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack sudo[106327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647 Sep 18 00:51:49 devstack sudo[106327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack sudo[106320]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.info" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:49 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.info is being set with open permissions: ugo+rw Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:49 devstack sudo[106329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.info Sep 18 00:51:49 devstack sudo[106329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:50 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:50 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:50 devstack sudo[106327]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:50 devstack sudo[106329]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-395d690e-23b8-4fd9-b4dc-f74dcc143647" returned: 0 in 0.310s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.info" returned: 0 in 0.277s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.225s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-quobyte-395d690e-23b8-4fd9-b4dc-f74dcc143647" released by "delete_volume" :: held 0.807s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.182s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:45Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8280cff7-892f-410e-976a-2c5088fa7b46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ed91b1efdd0545229b4d4a10e96b9fdc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:46Z,use_quota=True,user_id='87e8b091d9b74d4f8179f286aadad6ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Creating volume 8280cff7-892f-410e-976a-2c5088fa7b46 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:50 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:50 devstack sudo[106336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 1073741824 Sep 18 00:51:50 devstack sudo[106336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:50 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.330s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c3a69477-78fc-4408-ba65-c50f0c368c1f tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Deleted volume successfully. Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-216a419d-3263-4636-9eb6-e7de0162db92 tempest-CreateVolumesFromSnapshotTest-1755428680 None] Lock "cinder-b29f3d47-1ab1-416c-88a7-d1feb06f480f-delete_volume" released by "delete_volume" :: held 1.434s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Created reservations ['441ef6c1-e870-447f-885c-7edbdd9ae564', '11c084ee-9b42-404b-ae12-9153675626a9', '301495ec-8515-4559-aba4-da147670e390', '6ac1070d-756b-42af-9b56-a7b49ac42e27'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:50 devstack sudo[106338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:50 devstack sudo[106338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:50 devstack sudo[106338]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.326s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Deleted volume successfully. Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-15c122da-20e9-4f0c-941e-b8bebfbe070a tempest-CreateVolumesFromImageTest-1990840260 None] Lock "cinder-395d690e-23b8-4fd9-b4dc-f74dcc143647-delete_volume" released by "delete_volume" :: held 1.470s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:50 devstack sudo[106336]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 1073741824" returned: 0 in 0.574s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:50 devstack sudo[106346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 Sep 18 00:51:50 devstack sudo[106346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:51 devstack sudo[106346]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46" returned: 0 in 0.307s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] <== create_volume: return (933ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.937s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-2db46b12-404a-45ff-867e-d2628bc18d24-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-2db46b12-404a-45ff-867e-d2628bc18d24-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-e0f68110-e68e-4db1-bce1-0aecca81b0ac" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Attempting download of 2c86c70a-008b-4b50-a790-fa2bcd646a27 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c86c70a-008b-4b50-a790-fa2bcd646a27', 'metadata': {}}])) to volume 8280cff7-892f-410e-976a-2c5088fa7b46. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-e0f68110-e68e-4db1-bce1-0aecca81b0ac" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-2db46b12-404a-45ff-867e-d2628bc18d24" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-2db46b12-404a-45ff-867e-d2628bc18d24" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot 2db46b12-404a-45ff-867e-d2628bc18d24 of volume e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7ba1981-0fc6-4e7c-8468-819245981612]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[44c390ce-cf47-4217-b533-b9d755c05d41]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c86c70a-008b-4b50-a790-fa2bcd646a27_b9wzp115 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:51 devstack sudo[106350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 Sep 18 00:51:51 devstack sudo[106350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:51 devstack sudo[106351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c86c70a-008b-4b50-a790-fa2bcd646a27_b9wzp115 Sep 18 00:51:51 devstack sudo[106351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:51 devstack sudo[106350]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24" returned: 0 in 0.529s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:51:51 devstack sudo[106351]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2c86c70a-008b-4b50-a790-fa2bcd646a27_b9wzp115" returned: 0 in 0.535s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86c70a-008b-4b50-a790-fa2bcd646a27_b9wzp115 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b214996-37ee-4d49-99ea-a1ec49fc83d7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:52 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86c70a-008b-4b50-a790-fa2bcd646a27_b9wzp115 Sep 18 00:51:52 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:52 devstack sudo[106360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac Sep 18 00:51:52 devstack sudo[106360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:52 devstack sudo[106360]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:52 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac" returned: 0 in 0.483s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86c70a-008b-4b50-a790-fa2bcd646a27_b9wzp115" returned: 1 in 0.521s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2c86c70a-008b-4b50-a790-fa2bcd646a27_b9wzp115' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6dfe7d7-48fb-4972-970e-19625f76d4cb]: (4, 'raw') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:52 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 Sep 18 00:51:52 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:52 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD Sep 18 00:51:52 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:52 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24" returned: 0 in 0.427s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:52 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD" returned: 0 in 0.417s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:52 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24 Sep 18 00:51:52 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:53 devstack sudo[106379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD Sep 18 00:51:53 devstack sudo[106379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:53 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac.2db46b12-404a-45ff-867e-d2628bc18d24" returned: 0 in 0.295s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-2db46b12-404a-45ff-867e-d2628bc18d24" released by "_delete_snapshot" :: held 1.904s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-e0f68110-e68e-4db1-bce1-0aecca81b0ac" released by "delete_snapshot" :: held 1.934s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Created reservations ['42770a71-d1c0-4a45-bc2f-faa679953b27', '1d36f339-5345-4690-9204-72723ccdab0a', '779b28de-2376-4039-acea-96132383eff8', '33b4f334-df7c-470b-8f03-96be516928b9'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:53 devstack sudo[106379]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD" returned: 1 in 0.433s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] 2c86c70a-008b-4b50-a790-fa2bcd646a27 was raw, converting to qcow2 {{(pid=86526) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:53 devstack sudo[106386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 Sep 18 00:51:53 devstack sudo[106386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-6ed5a5a8-655b-4b02-a064-63515eb02a4f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-2db46b12-404a-45ff-867e-d2628bc18d24-delete_snapshot" released by "delete_snapshot" :: held 2.201s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Flow 'volume_create_manager' (a35247f1-3aef-4961-bb14-1ec89459ac2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1883e0e9-c5f5-4cb3-bfdf-8df4147bf05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1883e0e9-c5f5-4cb3-bfdf-8df4147bf05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1604955335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15d973b-f972-42f7-bac4-7e598154b5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8867026cdbf748babed44b032deb9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:54Z,use_quota=True,user_id='23d650a11a6f48c79a2e537a2a00b38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438f2498-e3d9-406c-9dd0-4d2a857ae86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (438f2498-e3d9-406c-9dd0-4d2a857ae86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fddb9a5-73c9-4c4e-ae83-5a4955a0189f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fddb9a5-73c9-4c4e-ae83-5a4955a0189f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c15d973b-f972-42f7-bac4-7e598154b5a3', 'volume_name': 'volume-c15d973b-f972-42f7-bac4-7e598154b5a3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce65fb1f-35c2-4876-ab49-b85f6e5a7a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce65fb1f-35c2-4876-ab49-b85f6e5a7a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a97133f-5ad6-495c-83de-5f991e161a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:53 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Volume c15d973b-f972-42f7-bac4-7e598154b5a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c15d973b-f972-42f7-bac4-7e598154b5a3', 'volume_size': 1} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1604955335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c15d973b-f972-42f7-bac4-7e598154b5a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8867026cdbf748babed44b032deb9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:54Z,use_quota=True,user_id='23d650a11a6f48c79a2e537a2a00b38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Creating volume c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:53 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:53 devstack sudo[106391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 1073741824 Sep 18 00:51:53 devstack sudo[106391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:53 devstack sudo[106386]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46" returned: 0 in 0.623s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2c86c70a-008b-4b50-a790-fa2bcd646a27_ulfxz4twdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:51:53 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Converted 0.00 MB image at 0.00 MB/s Sep 18 00:51:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:53 devstack sudo[106394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 1G Sep 18 00:51:53 devstack sudo[106394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:54 devstack sudo[106391]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 1073741824" returned: 0 in 0.481s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:54 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 Sep 18 00:51:54 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:54 devstack sudo[106394]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 1G" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Downloaded image 2c86c70a-008b-4b50-a790-fa2bcd646a27 ((None, [{'url': 'file:///opt/stack/data/glance/images/2c86c70a-008b-4b50-a790-fa2bcd646a27', 'metadata': {}}])) to volume 8280cff7-892f-410e-976a-2c5088fa7b46 successfully. {{(pid=86526) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Temporary image 2c86c70a-008b-4b50-a790-fa2bcd646a27 for user 87e8b091d9b74d4f8179f286aadad6ac is deleted. {{(pid=86526) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.volume_utils [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Marking volume 8280cff7-892f-410e-976a-2c5088fa7b46 as bootable. {{(pid=86526) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Copying metadata from image 2c86c70a-008b-4b50-a790-fa2bcd646a27 to 8280cff7-892f-410e-976a-2c5088fa7b46. {{(pid=86526) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Creating volume glance metadata for volume 8280cff7-892f-410e-976a-2c5088fa7b46 backed by image 2c86c70a-008b-4b50-a790-fa2bcd646a27 with: {'image_id': '2c86c70a-008b-4b50-a790-fa2bcd646a27', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'bdcbcaf0fb7624e4d68a2413421633ea', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86526) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e1fcfbb-f1fb-4ee0-9843-55e3fb4c1036) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8280cff7-892f-410e-976a-2c5088fa7b46', 'volume_size': 1, 'image_id': '2c86c70a-008b-4b50-a790-fa2bcd646a27', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2c86c70a-008b-4b50-a790-fa2bcd646a27', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'bdcbcaf0fb7624e4d68a2413421633ea', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'ed91b1efdd0545229b4d4a10e96b9fdc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'dea4716c3b07609b6eff66853602830fa3ed0c245c2717193a041b04c1e90eb7781e0f109e5c9365a56253037f670aed72397993c103c918f4eda719065cf9c1', 'id': '2c86c70a-008b-4b50-a790-fa2bcd646a27', 'created_at': datetime.datetime(2026, 9, 17, 22, 51, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 17, 22, 51, 44, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2c86c70a-008b-4b50-a790-fa2bcd646a27/file', 'properties': {}}, 'image_service': }' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767da1d8-881e-43e9-b849-2752f382eaf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:54 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Volume volume-8280cff7-892f-410e-976a-2c5088fa7b46 (8280cff7-892f-410e-976a-2c5088fa7b46): created successfully Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (767da1d8-881e-43e9-b849-2752f382eaf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Flow 'volume_create_manager' (4768eb12-2328-4c20-959b-683c3451bbbc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-e0f68110-e68e-4db1-bce1-0aecca81b0ac-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:54 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1b7daf98-f534-4d3d-a18c-2bc99b258cc1 tempest-VolumeImageDependencyTests-1266124187 None] Created volume successfully. Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-e0f68110-e68e-4db1-bce1-0aecca81b0ac-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:54 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-e0f68110-e68e-4db1-bce1-0aecca81b0ac" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3" returned: 0 in 0.308s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-e0f68110-e68e-4db1-bce1-0aecca81b0ac" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8a97133f-5ad6-495c-83de-5f991e161a8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c15d973b-f972-42f7-bac4-7e598154b5a3', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b488f0c-8814-447e-9381-37d2e5ea087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7892cc68-78f1-444d-bfe6-94ce849502db]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:54 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Volume volume-c15d973b-f972-42f7-bac4-7e598154b5a3 (c15d973b-f972-42f7-bac4-7e598154b5a3): created successfully Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2b488f0c-8814-447e-9381-37d2e5ea087b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Flow 'volume_create_manager' (a35247f1-3aef-4961-bb14-1ec89459ac2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:54 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ed15d404-06f1-479f-8285-3d09d00ca33e tempest-VolumeDependencyTests-488131829 None] Created volume successfully. Sep 18 00:51:54 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac Sep 18 00:51:54 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:54 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8d2861cd-265b-422a-ab72-11f403e9ac5a tempest-ProjectAdminTests-459374203 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1775.76655960083, 'free_capacity_gb': 1775.76655960083, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86526) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:55 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac" returned: 0 in 0.505s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Creating offline snapshot 7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 of volume c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:51:55 devstack sudo[106411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Acquiring lock "cinder-8280cff7-892f-410e-976a-2c5088fa7b46-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:55 devstack sudo[106411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[132642ef-6e23-4763-ac7a-ba1f83b52081]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Lock "cinder-8280cff7-892f-410e-976a-2c5088fa7b46-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Acquiring lock "cinder-quobyte-8280cff7-892f-410e-976a-2c5088fa7b46" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Lock "cinder-quobyte-8280cff7-892f-410e-976a-2c5088fa7b46" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:51:55 devstack sudo[106413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 Sep 18 00:51:55 devstack sudo[106413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfab7282-3094-4e32-98fe-47d31e672fe8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:55 devstack sudo[106411]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e0f68110-e68e-4db1-bce1-0aecca81b0ac" returned: 0 in 0.327s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-e0f68110-e68e-4db1-bce1-0aecca81b0ac" released by "delete_volume" :: held 0.919s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:55 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 Sep 18 00:51:55 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Created reservations ['96ff8f4d-7d03-42a1-88fd-b9661d0b8a65', '8762852b-32bd-4b28-a773-891f0860fcbc', '5fa97be1-c878-4d6b-91d2-a4a8390d3ff0', 'bba3e19f-00db-4124-a5d9-37b55bc8086a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:55 devstack sudo[106413]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3" returned: 0 in 0.469s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:55 devstack sudo[106421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:55 devstack sudo[106421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:55 devstack sudo[106422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 1G Sep 18 00:51:55 devstack sudo[106422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:55 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46" returned: 0 in 0.504s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:55 devstack sudo[106429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46 Sep 18 00:51:55 devstack sudo[106429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:55 devstack sudo[106421]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.330s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:55 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:56 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8776f9c1-d741-4a25-aa1e-2631a9df5b80 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-e0f68110-e68e-4db1-bce1-0aecca81b0ac-delete_volume" released by "delete_volume" :: held 1.527s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:56 devstack sudo[106429]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8280cff7-892f-410e-976a-2c5088fa7b46" returned: 0 in 0.393s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:56 devstack sudo[106422]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 1G" returned: 0 in 0.606s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15d973b-f972-42f7-bac4-7e598154b5a3 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Lock "cinder-quobyte-8280cff7-892f-410e-976a-2c5088fa7b46" released by "delete_volume" :: held 0.971s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:56 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15d973b-f972-42f7-bac4-7e598154b5a3 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 Sep 18 00:51:56 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Created reservations ['6e7f77a2-26e8-4fa8-9107-5e346e5f4f34', 'ea3811ab-dca9-4708-b080-136a2cfdd5cc', '8b9ad26d-31ba-41a4-a890-416721dfaa3c', '3d541809-597b-4bf7-bd62-10c55b696562'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:56 devstack sudo[106439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:51:56 devstack sudo[106439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:56 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c15d973b-f972-42f7-bac4-7e598154b5a3 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" returned: 0 in 0.454s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:56 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 is being set with open permissions: ugo+rw Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:56 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (da72b5c1-6959-4f38-9f11-cd829dac1000) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:56 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709b26a7-d5cc-4a83-a293-6b87c0bf151e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (709b26a7-d5cc-4a83-a293-6b87c0bf151e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937680242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b44f1ba-576f-4585-8a12-f017bb510094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:57Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834327c2-3ec2-4693-b43d-4d698694651b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (834327c2-3ec2-4693-b43d-4d698694651b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a5a433-a0af-4c7e-a546-3c773490e9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3a5a433-a0af-4c7e-a546-3c773490e9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b44f1ba-576f-4585-8a12-f017bb510094', 'volume_name': 'volume-8b44f1ba-576f-4585-8a12-f017bb510094', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba388908-80ba-41d1-8dc8-8b9ca9b4d2d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba388908-80ba-41d1-8dc8-8b9ca9b4d2d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdab3bd4-2780-4f77-b41e-7c592f360d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:56 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Volume 8b44f1ba-576f-4585-8a12-f017bb510094: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b44f1ba-576f-4585-8a12-f017bb510094', 'volume_size': 1} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:56 devstack sudo[106439]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:51:56 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Deleted volume successfully. Sep 18 00:51:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4d59f64b-5eaf-4364-9541-993be9ab9d74 tempest-VolumeImageDependencyTests-1266124187 None] Lock "cinder-8280cff7-892f-410e-976a-2c5088fa7b46-delete_volume" released by "delete_volume" :: held 1.719s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:51:57 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:57 devstack sudo[106448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.info Sep 18 00:51:57 devstack sudo[106448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:57 devstack sudo[106448]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.info" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:57 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.info is being set with open permissions: ugo+rw Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:57 devstack sudo[106451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.info Sep 18 00:51:57 devstack sudo[106451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:57 devstack sudo[106451]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.info" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.503s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.783s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1937680242',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b44f1ba-576f-4585-8a12-f017bb510094,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:57Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Creating volume 8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:51:57 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:51:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:57 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 1073741824 Sep 18 00:51:57 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:57 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ad29bee3-9094-4889-9507-20a3aa0c30e7 tempest-VolumeDependencyTests-488131829 None] Create snapshot completed successfully Sep 18 00:51:58 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 1073741824" returned: 0 in 0.531s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:58 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 Sep 18 00:51:58 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:58 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094" returned: 0 in 0.302s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.897s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdab3bd4-2780-4f77-b41e-7c592f360d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b44f1ba-576f-4585-8a12-f017bb510094', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda17d5a-4713-4d89-b75b-2f308242189b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:58 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Volume volume-8b44f1ba-576f-4585-8a12-f017bb510094 (8b44f1ba-576f-4585-8a12-f017bb510094): created successfully Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dda17d5a-4713-4d89-b75b-2f308242189b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:58 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (da72b5c1-6959-4f38-9f11-cd829dac1000) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:58 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3324d13b-0ffb-47e5-97f0-c3f97c47234b tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot 24c52342-1fc4-495b-8ac3-2ccf0e10c5fd of volume 8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Flow 'volume_create_manager' (d8d7119f-b184-4b5c-ae0d-349886d2802f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e9013b-6e33-4ca6-ab39-9514521a9f01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e1dad36-686b-4bbb-aa35-2c9023b09b41]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69e9013b-6e33-4ca6-ab39-9514521a9f01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1498996975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c6c9475-f946-4ca3-a58c-07aaffb94d00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8867026cdbf748babed44b032deb9a77',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:51:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:51:59Z,use_quota=True,user_id='23d650a11a6f48c79a2e537a2a00b38f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3134f806-24b8-4eaf-b74d-3da59d560689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3134f806-24b8-4eaf-b74d-3da59d560689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54f1833-2834-408b-9c5e-b86082805772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b54f1833-2834-408b-9c5e-b86082805772) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3c6c9475-f946-4ca3-a58c-07aaffb94d00', 'volume_name': 'volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00', 'volume_size': 1, 'snapshot_id': '7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca7fbc4-6676-4389-b042-6e84f071213d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9ca7fbc4-6676-4389-b042-6e84f071213d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757147b5-9430-4a21-b2ab-f2f5818940d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:51:59 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Volume 3c6c9475-f946-4ca3-a58c-07aaffb94d00: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00', 'volume_size': 1, 'snapshot_id': '7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9'} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:51:59 devstack sudo[106463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 Sep 18 00:51:59 devstack sudo[106463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:51:59 devstack sudo[106463]: pam_unix(sudo:session): session closed for user root Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094" returned: 0 in 0.512s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:51:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:51:59 devstack sudo[106468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd 1G Sep 18 00:51:59 devstack sudo[106468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:00 devstack sudo[106468]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd 1G" returned: 0 in 0.501s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b44f1ba-576f-4585-8a12-f017bb510094 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:00 devstack sudo[106474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b44f1ba-576f-4585-8a12-f017bb510094 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd Sep 18 00:52:00 devstack sudo[106474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:00 devstack sudo[106474]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8b44f1ba-576f-4585-8a12-f017bb510094 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" returned: 0 in 0.372s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:00 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd is being set with open permissions: ugo+rw Sep 18 00:52:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:00 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd Sep 18 00:52:00 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:00 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:00 devstack sudo[106483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.info Sep 18 00:52:00 devstack sudo[106483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:01 devstack sudo[106483]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.info" returned: 0 in 0.335s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:01 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.info is being set with open permissions: ugo+rw Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:01 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.info Sep 18 00:52:01 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:01 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.info" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 2.194s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-quobyte-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9-3c6c9475-f946-4ca3-a58c-07aaffb94d00" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9-3c6c9475-f946-4ca3-a58c-07aaffb94d00" acquired by "_create_volume_from_snapshot" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Creating volume 3c6c9475-f946-4ca3-a58c-07aaffb94d00 from snapshot 7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-quobyte-3c6c9475-f946-4ca3-a58c-07aaffb94d00" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:01 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-3861a185-d2fa-4f2b-9bcd-801cb7492d54 tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-3c6c9475-f946-4ca3-a58c-07aaffb94d00" acquired by "_copy_volume_from_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] snapshot: 7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9, volume: 3c6c9475-f946-4ca3-a58c-07aaffb94d00, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a948100-79e8-4b2a-9252-20a3d8ca286c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:01 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 Sep 18 00:52:01 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:02 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-24c52342-1fc4-495b-8ac3-2ccf0e10c5fd-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" returned: 0 in 0.508s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15d973b-f972-42f7-bac4-7e598154b5a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-24c52342-1fc4-495b-8ac3-2ccf0e10c5fd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-8b44f1ba-576f-4585-8a12-f017bb510094" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d815e7e-5dc2-47a3-99ff-d138f1e1377c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-8b44f1ba-576f-4585-8a12-f017bb510094" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot 24c52342-1fc4-495b-8ac3-2ccf0e10c5fd of volume 8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b776c08a-5f5c-4534-955f-9b6475791df8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:02 devstack sudo[106497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 Sep 18 00:52:02 devstack sudo[106497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:02 devstack sudo[106498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd Sep 18 00:52:02 devstack sudo[106498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:02 devstack sudo[106497]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3" returned: 0 in 0.497s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:02 devstack sudo[106506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 Sep 18 00:52:02 devstack sudo[106506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:02 devstack sudo[106498]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" returned: 0 in 0.451s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8b44f1ba-576f-4585-8a12-f017bb510094(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[62d17a30-f02b-4590-9814-1cd4447d2c57]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:02 devstack sudo[106509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 Sep 18 00:52:02 devstack sudo[106509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:03 devstack sudo[106509]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094" returned: 0 in 0.537s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:03 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd Sep 18 00:52:03 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:04 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" returned: 0 in 0.762s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:04 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd Sep 18 00:52:04 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:04 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:04 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:04 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094.24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" returned: 0 in 0.573s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-24c52342-1fc4-495b-8ac3-2ccf0e10c5fd" released by "_delete_snapshot" :: held 2.587s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-8b44f1ba-576f-4585-8a12-f017bb510094" released by "delete_snapshot" :: held 2.627s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:04 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.502s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 29 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:52:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:52:05 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Created reservations ['9a8acb33-5452-4098-b2e2-b09f3d3a2b3b', '9785a253-f739-4b59-9013-040b9ba3c901', '5585cfe9-c908-4368-be77-8faa4d0c8d87', '393d4972-0afe-4833-bfd9-edabdb8c6b39'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:05 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:52:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-081409e9-3285-4137-b1ba-1aca2d0f9f57 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-24c52342-1fc4-495b-8ac3-2ccf0e10c5fd-delete_snapshot" released by "delete_snapshot" :: held 2.946s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-8b44f1ba-576f-4585-8a12-f017bb510094-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-8b44f1ba-576f-4585-8a12-f017bb510094-delete_volume" acquired by "delete_volume" :: waited 0.058s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-8b44f1ba-576f-4585-8a12-f017bb510094" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-8b44f1ba-576f-4585-8a12-f017bb510094" acquired by "delete_volume" :: waited 0.039s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:06 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b88d0ea5-10f8-40f3-8548-44ba86cf2146]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:06 devstack sudo[106538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 Sep 18 00:52:06 devstack sudo[106538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:06 devstack sudo[106538]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094" returned: 0 in 0.549s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:06 devstack sudo[106543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094 Sep 18 00:52:06 devstack sudo[106543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:07 devstack sudo[106543]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-8b44f1ba-576f-4585-8a12-f017bb510094" returned: 0 in 0.392s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-8b44f1ba-576f-4585-8a12-f017bb510094" released by "delete_volume" :: held 1.130s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Created reservations ['05d6ac19-88fd-4eb4-b088-9c4cf813512f', '4697401f-0f71-4bda-afe2-40528c4fffe6', 'd9a15524-07ea-430e-804d-976af6e00ec7', '85b878da-c713-4e0c-b612-a16d8b61319e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (8469c365-8763-4479-aedf-05bdd358c84a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58d0336-3a8d-48ca-ba36-ed4ed62ae3b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e58d0336-3a8d-48ca-ba36-ed4ed62ae3b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162604078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17137a8-d11a-43b9-b578-a8bcdfdf5506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:07Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade72593-c193-40e3-b20a-5a5d73a3536e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ade72593-c193-40e3-b20a-5a5d73a3536e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d399a8-322f-4b85-ad0a-0f38453f85df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4d399a8-322f-4b85-ad0a-0f38453f85df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e17137a8-d11a-43b9-b578-a8bcdfdf5506', 'volume_name': 'volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fba9d09-6ec8-4e1f-bb78-7c631a9be08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fba9d09-6ec8-4e1f-bb78-7c631a9be08e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff713e3c-f24c-4522-8017-ce52a810b704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:07 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Volume e17137a8-d11a-43b9-b578-a8bcdfdf5506: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506', 'volume_size': 1} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:07 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:07 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:08 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.573s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:08 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:08 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:52:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-149cf9c2-00e5-4b7f-86bd-c3939d339f31 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-8b44f1ba-576f-4585-8a12-f017bb510094-delete_volume" released by "delete_volume" :: held 2.370s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (fdff7b17-8527-4f57-8bcd-5549de8bae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82721d0-7dda-46e9-94d9-6a91a5b1fa6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f82721d0-7dda-46e9-94d9-6a91a5b1fa6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478123580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03fe5b0-5b54-4544-a121-794a48bae743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:09Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d41dd3-11dd-4558-9f36-b097bba538f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90d41dd3-11dd-4558-9f36-b097bba538f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be831009-36ff-4666-a773-8619c8d3181c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be831009-36ff-4666-a773-8619c8d3181c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a03fe5b0-5b54-4544-a121-794a48bae743', 'volume_name': 'volume-a03fe5b0-5b54-4544-a121-794a48bae743', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5914c64-be4c-4de1-b980-a5a9ad9034fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5914c64-be4c-4de1-b980-a5a9ad9034fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189a814c-2d87-4d01-b38f-2274acbcb4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:09 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Volume a03fe5b0-5b54-4544-a121-794a48bae743: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a03fe5b0-5b54-4544-a121-794a48bae743', 'volume_size': 1} Sep 18 00:52:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:11 devstack sudo[106506]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00" returned: 0 in 8.909s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3, size 1024.00 MB, duration 8.91 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:52:11 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Converted 1024.00 MB image at 114.93 MB/s Sep 18 00:52:11 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 is being set with open permissions: ugo+rw Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:11 devstack sudo[106586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 Sep 18 00:52:11 devstack sudo[106586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:11 devstack sudo[106586]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00" returned: 0 in 0.255s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-3c6c9475-f946-4ca3-a58c-07aaffb94d00" released by "_copy_volume_from_snapshot" :: held 10.285s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9-3c6c9475-f946-4ca3-a58c-07aaffb94d00" released by "_create_volume_from_snapshot" :: held 10.354s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.390s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.515s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-162604078',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e17137a8-d11a-43b9-b578-a8bcdfdf5506,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:07Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Creating volume e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:11 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:11 devstack sudo[106589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 1073741824 Sep 18 00:52:11 devstack sudo[106589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:11 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (757147b5-9430-4a21-b2ab-f2f5818940d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00', 'volume_size': 1, 'snapshot_id': '7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105f2011-e1f5-4a7c-80d0-fd89634a0817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:12 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Volume volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 (3c6c9475-f946-4ca3-a58c-07aaffb94d00): created successfully Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (105f2011-e1f5-4a7c-80d0-fd89634a0817) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Flow 'volume_create_manager' (d8d7119f-b184-4b5c-ae0d-349886d2802f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-63bcf691-8ba9-49ae-a0bb-c086cae7eccc tempest-VolumeDependencyTests-488131829 None] Created volume successfully. Sep 18 00:52:12 devstack sudo[106589]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 1073741824" returned: 0 in 0.452s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:12 devstack sudo[106595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 Sep 18 00:52:12 devstack sudo[106595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:12 devstack sudo[106595]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.186s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1478123580',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a03fe5b0-5b54-4544-a121-794a48bae743,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:09Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Creating volume a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:12 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ff713e3c-f24c-4522-8017-ce52a810b704) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:12 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 1073741824 Sep 18 00:52:12 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18860274-561e-4a50-9da3-2069b305f295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:12 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Volume volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 (e17137a8-d11a-43b9-b578-a8bcdfdf5506): created successfully Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (18860274-561e-4a50-9da3-2069b305f295) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (8469c365-8763-4479-aedf-05bdd358c84a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Lock "cinder-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-quobyte-c15d973b-f972-42f7-bac4-7e598154b5a3" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:12 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f289d422-fd12-4c58-8b1f-4b7ca69e46b3 tempest-ProjectReaderTests-636043275 None] Created volume successfully. Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-c15d973b-f972-42f7-bac4-7e598154b5a3" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-quobyte-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Deleting offline snapshot 7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 of volume c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] snapshot_file for this snap is: volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a03264b-da65-4893-87e4-3ab25dab4e6d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:13 devstack sudo[106600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 Sep 18 00:52:13 devstack sudo[106600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Flow 'volume_create_manager' (9fdfa512-4848-408f-8062-e6c725ddcb1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f211220-43ff-43f7-95db-50b16f0fc627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f211220-43ff-43f7-95db-50b16f0fc627) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318889056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89074125-ef12-4e08-97c5-fc2338130b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919adf4280664a998186811748b64007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:13Z,use_quota=True,user_id='74e792dca8994cb79aedc5d2dd59b90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6736ad-e34f-4bf9-b6a0-cd39177e27ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:13 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fc6736ad-e34f-4bf9-b6a0-cd39177e27ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166e45c5-c60b-4ce7-aa9f-50765c3f7fd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (166e45c5-c60b-4ce7-aa9f-50765c3f7fd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89074125-ef12-4e08-97c5-fc2338130b55', 'volume_name': 'volume-89074125-ef12-4e08-97c5-fc2338130b55', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a31e9b8-9ec5-4ad2-bb46-b72d069472c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a31e9b8-9ec5-4ad2-bb46-b72d069472c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9ddd18-3f48-4ef0-be49-021d58338295) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:13 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Volume 89074125-ef12-4e08-97c5-fc2338130b55: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89074125-ef12-4e08-97c5-fc2338130b55', 'volume_size': 1} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 1073741824" returned: 0 in 0.537s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:13 devstack sudo[106609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 Sep 18 00:52:13 devstack sudo[106609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:13 devstack sudo[106600]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" returned: 0 in 0.431s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c15d973b-f972-42f7-bac4-7e598154b5a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[278c4be2-7bbc-43c4-b491-182dd99529ff]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:13 devstack sudo[106611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 Sep 18 00:52:13 devstack sudo[106611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:13 devstack sudo[106609]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743" returned: 0 in 0.246s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (828ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.293s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-318889056',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89074125-ef12-4e08-97c5-fc2338130b55,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919adf4280664a998186811748b64007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:13Z,use_quota=True,user_id='74e792dca8994cb79aedc5d2dd59b90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Creating volume 89074125-ef12-4e08-97c5-fc2338130b55 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:13 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:13 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 1073741824 Sep 18 00:52:13 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (189a814c-2d87-4d01-b38f-2274acbcb4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a03fe5b0-5b54-4544-a121-794a48bae743', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e358d73-73a0-4b70-970b-77fc79021c80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:13 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Volume volume-a03fe5b0-5b54-4544-a121-794a48bae743 (a03fe5b0-5b54-4544-a121-794a48bae743): created successfully Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5e358d73-73a0-4b70-970b-77fc79021c80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (fdff7b17-8527-4f57-8bcd-5549de8bae67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=224,cinder:UPDATE=291,cinder:INSERT=76,cinder:DELETE=31 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:52:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-60bec894-1e43-46d9-96f3-4b87f33ba2e8 tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:52:13 devstack sudo[106611]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3" returned: 0 in 0.587s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:13 devstack sudo[106630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 Sep 18 00:52:13 devstack sudo[106630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=306,cinder:SELECT=221,cinder:DELETE=24,cinder:INSERT=83 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:14 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 1073741824" returned: 0 in 0.525s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:14 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 Sep 18 00:52:14 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:14 devstack sudo[106630]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" returned: 0 in 0.398s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:14 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9 Sep 18 00:52:14 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:14 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.847s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.324s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a9ddd18-3f48-4ef0-be49-021d58338295) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89074125-ef12-4e08-97c5-fc2338130b55', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711d1347-e8ff-43da-bc42-28203d573e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Creating offline snapshot 53551442-fb6e-490a-98ac-03e94af33c47 of volume e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Volume volume-89074125-ef12-4e08-97c5-fc2338130b55 (89074125-ef12-4e08-97c5-fc2338130b55): created successfully Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (711d1347-e8ff-43da-bc42-28203d573e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Flow 'volume_create_manager' (9fdfa512-4848-408f-8062-e6c725ddcb1e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[97dcaf7a-6cf4-4659-a8c4-e4e7bb806f98]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-2ba13af5-bb64-4bf0-a8c2-7d508b094e99 tempest-ProjectReaderTests-1579425064 None] Created volume successfully. Sep 18 00:52:14 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 Sep 18 00:52:14 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:14 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3.7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" returned: 0 in 0.285s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9" released by "_delete_snapshot" :: held 1.818s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-c15d973b-f972-42f7-bac4-7e598154b5a3" released by "delete_snapshot" :: held 1.848s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Created reservations ['f18984a9-9722-4639-b402-8e3eb3ad801c', 'f1928611-99c0-406b-b6ab-432f4d53bf17', 'dfa33f1f-e2f6-40c3-a350-8c9a3e919bb9', 'f86066ac-770e-444f-b5ab-3853257ea89a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Delete snapshot completed successfully. Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1e658d0f-67c4-4077-a41d-c9d9e7f63dba tempest-VolumeDependencyTests-488131829 None] Lock "cinder-7034d9b9-3a1e-4dad-b7a6-f7c4cedee7b9-delete_snapshot" released by "delete_snapshot" :: held 2.039s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:14 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506" returned: 0 in 0.423s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:14 devstack sudo[106646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 1G Sep 18 00:52:14 devstack sudo[106646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-c15d973b-f972-42f7-bac4-7e598154b5a3-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:14 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Lock "cinder-c15d973b-f972-42f7-bac4-7e598154b5a3-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-quobyte-c15d973b-f972-42f7-bac4-7e598154b5a3" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-c15d973b-f972-42f7-bac4-7e598154b5a3" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[92ff823e-5e9c-4888-a3d6-68fdd3ff9e1f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:15 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 Sep 18 00:52:15 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:15 devstack sudo[106646]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 1G" returned: 0 in 0.464s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:15 devstack sudo[106653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 Sep 18 00:52:15 devstack sudo[106653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Acquiring lock "cinder-89074125-ef12-4e08-97c5-fc2338130b55-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Lock "cinder-89074125-ef12-4e08-97c5-fc2338130b55-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Acquiring lock "cinder-quobyte-89074125-ef12-4e08-97c5-fc2338130b55" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Lock "cinder-quobyte-89074125-ef12-4e08-97c5-fc2338130b55" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:15 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3" returned: 0 in 0.442s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8a10264-6ff4-43c4-9ca5-3df263000b5f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:15 devstack sudo[106658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3 Sep 18 00:52:15 devstack sudo[106658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:15 devstack sudo[106659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 Sep 18 00:52:15 devstack sudo[106659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:15 devstack sudo[106653]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47" returned: 0 in 0.341s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:15 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 is being set with open permissions: ugo+rw Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:15 devstack sudo[106665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 Sep 18 00:52:15 devstack sudo[106665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:15 devstack sudo[106658]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c15d973b-f972-42f7-bac4-7e598154b5a3" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-c15d973b-f972-42f7-bac4-7e598154b5a3" released by "delete_volume" :: held 0.798s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Created reservations ['996d0731-e394-486a-9784-ada422e62b5a', '3d691722-4e3b-4022-9339-b78d3ea95f58', '7e741c7a-e5b9-4f69-8ed2-545c4e1f0e7a', '6860ad7a-d27b-4d09-85cc-a08983df7776'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:15 devstack sudo[106665]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:15 devstack sudo[106659]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55" returned: 0 in 0.441s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47" returned: 0 in 0.297s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:16 devstack sudo[106673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:16 devstack sudo[106673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:16 devstack sudo[106674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55 Sep 18 00:52:16 devstack sudo[106674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:16 devstack sudo[106677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.info Sep 18 00:52:16 devstack sudo[106677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-3c6c9475-f946-4ca3-a58c-07aaffb94d00-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Lock "cinder-3c6c9475-f946-4ca3-a58c-07aaffb94d00-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Acquiring lock "cinder-quobyte-3c6c9475-f946-4ca3-a58c-07aaffb94d00" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-3c6c9475-f946-4ca3-a58c-07aaffb94d00" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[98495939-7eef-46e1-bdc2-f0e27de83da7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:16 devstack sudo[106673]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.331s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Deleted volume successfully. Sep 18 00:52:16 devstack sudo[106674]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4e5daf84-cb04-4df9-93c1-881865413b8f tempest-VolumeDependencyTests-488131829 None] Lock "cinder-c15d973b-f972-42f7-bac4-7e598154b5a3-delete_volume" released by "delete_volume" :: held 1.357s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-89074125-ef12-4e08-97c5-fc2338130b55" returned: 0 in 0.350s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Lock "cinder-quobyte-89074125-ef12-4e08-97c5-fc2338130b55" released by "delete_volume" :: held 0.842s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Created reservations ['267dff11-48eb-4a1b-af94-74b76117fdb5', '070957e3-d193-4944-becd-2a4f3cd0ae9d', '6a88fbb6-b415-4c4c-ba84-33db8c8c04c5', '1b30f7fc-207c-4ba2-874b-e5087577a466'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:16 devstack sudo[106681]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 Sep 18 00:52:16 devstack sudo[106681]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:16 devstack sudo[106677]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.info" returned: 0 in 0.389s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:16 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.info is being set with open permissions: ugo+rw Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:16 devstack sudo[106684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.info Sep 18 00:52:16 devstack sudo[106684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:16 devstack sudo[106686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:16 devstack sudo[106686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:16 devstack sudo[106681]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00" returned: 0 in 0.407s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:16 devstack sudo[106684]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.info" returned: 0 in 0.292s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:16 devstack sudo[106693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00 Sep 18 00:52:16 devstack sudo[106693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.350s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.955s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot 4fce31c9-7196-43a0-bc93-6b325061aa5a of volume a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:16 devstack sudo[106686]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.305s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Deleted volume successfully. Sep 18 00:52:16 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-20b66658-233f-4705-9d40-c8ea57cad7cb tempest-ProjectReaderTests-636043275 None] Create snapshot completed successfully Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[47816ac9-aab6-46ae-9665-a5755acfbf49]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c364ad6a-bf01-4680-a8dd-0e5822d1d77d tempest-ProjectReaderTests-1579425064 None] Lock "cinder-89074125-ef12-4e08-97c5-fc2338130b55-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:16 devstack sudo[106696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 Sep 18 00:52:16 devstack sudo[106696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:17 devstack sudo[106693]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-3c6c9475-f946-4ca3-a58c-07aaffb94d00" returned: 0 in 0.307s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Lock "cinder-quobyte-3c6c9475-f946-4ca3-a58c-07aaffb94d00" released by "delete_volume" :: held 0.783s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Created reservations ['b8345f53-9d23-4b97-920e-1608cb94bb3b', 'd085565c-a654-4e71-bc22-21425c76b726', '7d5fe1dc-a746-4922-9203-e8f9cd4b5c0a', '72a54912-8e07-45e5-b558-9b959c027d75'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Flow 'volume_create_manager' (93c55a42-8ba2-410a-b85b-3c27e1d7faaa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bfac1f-38be-4862-9318-9ff464f85688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:17 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:17 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:17 devstack sudo[106696]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34bfac1f-38be-4862-9318-9ff464f85688) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1419520240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dfab6e-962b-4df7-a476-1fdde6c59f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919adf4280664a998186811748b64007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:17Z,use_quota=True,user_id='74e792dca8994cb79aedc5d2dd59b90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a128f8-9e29-49de-a0df-1ba42172a375) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6a128f8-9e29-49de-a0df-1ba42172a375) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f90948-5ff1-4c45-8e9c-a755e08c78d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f90948-5ff1-4c45-8e9c-a755e08c78d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b0dfab6e-962b-4df7-a476-1fdde6c59f42', 'volume_name': 'volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daffc717-f52c-4330-9203-d8c346d9eb92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (daffc717-f52c-4330-9203-d8c346d9eb92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342a19a1-0ecd-4e12-b214-c71ce06ae29a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:17 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Volume b0dfab6e-962b-4df7-a476-1fdde6c59f42: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42', 'volume_size': 1} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743" returned: 0 in 0.541s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:17 devstack sudo[106704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a 1G Sep 18 00:52:17 devstack sudo[106704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-53551442-fb6e-490a-98ac-03e94af33c47-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Lock "cinder-53551442-fb6e-490a-98ac-03e94af33c47-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-e17137a8-d11a-43b9-b578-a8bcdfdf5506" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-e17137a8-d11a-43b9-b578-a8bcdfdf5506" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-53551442-fb6e-490a-98ac-03e94af33c47" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-53551442-fb6e-490a-98ac-03e94af33c47" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Deleting offline snapshot 53551442-fb6e-490a-98ac-03e94af33c47 of volume e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:17 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] snapshot_file for this snap is: volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.289s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Deleted volume successfully. Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[41569805-95bc-4da8-bb95-e8214e39d734]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-53815ec8-9ed0-4893-b0d4-b5532795d2ab tempest-VolumeDependencyTests-488131829 None] Lock "cinder-3c6c9475-f946-4ca3-a58c-07aaffb94d00-delete_volume" released by "delete_volume" :: held 1.398s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:17 devstack sudo[106707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 Sep 18 00:52:17 devstack sudo[106707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:17 devstack sudo[106704]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a 1G" returned: 0 in 0.507s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03fe5b0-5b54-4544-a121-794a48bae743 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:17 devstack sudo[106714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03fe5b0-5b54-4544-a121-794a48bae743 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a Sep 18 00:52:17 devstack sudo[106714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:17 devstack sudo[106707]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47" returned: 0 in 0.427s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f96e8b90-dbc1-4b9a-8394-dbe84ae0c5de]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:18 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 Sep 18 00:52:18 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:18 devstack sudo[106714]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a03fe5b0-5b54-4544-a121-794a48bae743 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a" returned: 0 in 0.359s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:18 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a is being set with open permissions: ugo+rw Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:18 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a Sep 18 00:52:18 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:18 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506" returned: 0 in 0.433s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:18 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 Sep 18 00:52:18 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:18 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a" returned: 0 in 0.293s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:18 devstack sudo[106732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.info Sep 18 00:52:18 devstack sudo[106732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:18 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47" returned: 0 in 0.401s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:18 devstack sudo[106732]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.info" returned: 0 in 0.317s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:18 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.info is being set with open permissions: ugo+rw Sep 18 00:52:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:18 devstack sudo[106738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47 Sep 18 00:52:18 devstack sudo[106738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:18 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.info Sep 18 00:52:18 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:19 devstack sudo[106738]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506.53551442-fb6e-490a-98ac-03e94af33c47" returned: 0 in 0.268s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-53551442-fb6e-490a-98ac-03e94af33c47" released by "_delete_snapshot" :: held 1.662s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-e17137a8-d11a-43b9-b578-a8bcdfdf5506" released by "delete_snapshot" :: held 1.693s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:19 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.info" returned: 0 in 0.323s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.469s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.865s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1419520240',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b0dfab6e-962b-4df7-a476-1fdde6c59f42,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='919adf4280664a998186811748b64007',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:17Z,use_quota=True,user_id='74e792dca8994cb79aedc5d2dd59b90f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Creating volume b0dfab6e-962b-4df7-a476-1fdde6c59f42 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:19 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:19 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 1073741824 Sep 18 00:52:19 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-62a9c8fb-ceaa-4d02-b359-443d61d2e63b tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Created reservations ['db462152-3924-4d1e-adb0-74d76bad11a4', 'e8782205-cf22-4020-b355-e8bf3dce9d07', '4d782a8d-ac14-4554-bf5d-1070b7aea26d', 'ddf87593-c8a6-4842-96b7-f7a1f92e249e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Delete snapshot completed successfully. Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa1e8f35-411e-4e0d-9fcb-a66bba159117 tempest-ProjectReaderTests-636043275 None] Lock "cinder-53551442-fb6e-490a-98ac-03e94af33c47-delete_snapshot" released by "delete_snapshot" :: held 1.933s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-e17137a8-d11a-43b9-b578-a8bcdfdf5506-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Lock "cinder-e17137a8-d11a-43b9-b578-a8bcdfdf5506-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-e17137a8-d11a-43b9-b578-a8bcdfdf5506" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-e17137a8-d11a-43b9-b578-a8bcdfdf5506" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e2a4759-ddb9-4c1f-9233-fc6993ff56a1]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:19 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 1073741824" returned: 0 in 0.547s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:19 devstack sudo[106751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 Sep 18 00:52:19 devstack sudo[106751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:19 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 Sep 18 00:52:19 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-4fce31c9-7196-43a0-bc93-6b325061aa5a-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:20 devstack sudo[106751]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-4fce31c9-7196-43a0-bc93-6b325061aa5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-a03fe5b0-5b54-4544-a121-794a48bae743" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42" returned: 0 in 0.286s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (342a19a1-0ecd-4e12-b214-c71ce06ae29a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517c10af-893e-422c-9cc2-068123624181) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-a03fe5b0-5b54-4544-a121-794a48bae743" acquired by "delete_snapshot" :: waited 0.062s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-4fce31c9-7196-43a0-bc93-6b325061aa5a" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-4fce31c9-7196-43a0-bc93-6b325061aa5a" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot 4fce31c9-7196-43a0-bc93-6b325061aa5a of volume a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:20 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Volume volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 (b0dfab6e-962b-4df7-a476-1fdde6c59f42): created successfully Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (517c10af-893e-422c-9cc2-068123624181) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:20 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Flow 'volume_create_manager' (93c55a42-8ba2-410a-b85b-3c27e1d7faaa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[13dd4377-af73-4b1d-be95-bc8d8f6dd54b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506" returned: 0 in 0.489s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-15eea945-a73d-4dd5-9b9a-cc4d20e07eef tempest-ProjectReaderTests-1579425064 None] Created volume successfully. Sep 18 00:52:20 devstack sudo[106759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506 Sep 18 00:52:20 devstack sudo[106759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Acquiring lock "cinder-b0dfab6e-962b-4df7-a476-1fdde6c59f42-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:20 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a Sep 18 00:52:20 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Lock "cinder-b0dfab6e-962b-4df7-a476-1fdde6c59f42-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Acquiring lock "cinder-quobyte-b0dfab6e-962b-4df7-a476-1fdde6c59f42" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Lock "cinder-quobyte-b0dfab6e-962b-4df7-a476-1fdde6c59f42" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a859c10b-8dc2-4fc2-8d8e-358d9e95501b]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:20 devstack sudo[106759]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-e17137a8-d11a-43b9-b578-a8bcdfdf5506" returned: 0 in 0.375s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-e17137a8-d11a-43b9-b578-a8bcdfdf5506" released by "delete_volume" :: held 0.947s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:20 devstack sudo[106763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 Sep 18 00:52:20 devstack sudo[106763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Created reservations ['c2a5f252-dfdc-4616-8bea-3862d8e2cb2f', 'c5b3f1ea-39a5-4aae-80af-ae33a4b4b223', 'e8ac68b8-ff83-4671-bd14-dcc0eefb5a69', 'fcaa2cac-bd91-4ddf-888d-ac59ce656c15'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:20 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a" returned: 0 in 0.604s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a03fe5b0-5b54-4544-a121-794a48bae743(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:20 devstack sudo[106768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:20 devstack sudo[106768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8037876-4414-4f4d-8110-25f1a74b8dc8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:21 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 Sep 18 00:52:21 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:21 devstack sudo[106763]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42" returned: 0 in 0.461s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:21 devstack sudo[106775]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42 Sep 18 00:52:21 devstack sudo[106775]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:21 devstack sudo[106768]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.347s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Deleted volume successfully. Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-b8d37ab9-db68-4897-bd4f-15bcafcb1f11 tempest-ProjectReaderTests-636043275 None] Lock "cinder-e17137a8-d11a-43b9-b578-a8bcdfdf5506-delete_volume" released by "delete_volume" :: held 1.586s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:21 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743" returned: 0 in 0.440s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:21 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a Sep 18 00:52:21 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:21 devstack sudo[106775]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-b0dfab6e-962b-4df7-a476-1fdde6c59f42" returned: 0 in 0.334s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Lock "cinder-quobyte-b0dfab6e-962b-4df7-a476-1fdde6c59f42" released by "delete_volume" :: held 0.850s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Created reservations ['b82ecca8-877c-4087-aa55-d00c623881ed', '3f8d6674-9c6d-4425-8cb8-e85e1a605c20', 'f0cd8fac-e274-45df-af9f-a3c2e06e3044', '8a624b62-a871-4b8d-a438-d647bd4f44c3'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:21 devstack sudo[106787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:21 devstack sudo[106787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:21 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a" returned: 0 in 0.419s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:21 devstack sudo[106792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a Sep 18 00:52:21 devstack sudo[106792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:21 devstack sudo[106787]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.313s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Deleted volume successfully. Sep 18 00:52:21 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-d5a0145f-ee64-402c-aec7-0aca8c069ebe tempest-ProjectReaderTests-1579425064 None] Lock "cinder-b0dfab6e-962b-4df7-a476-1fdde6c59f42-delete_volume" released by "delete_volume" :: held 1.464s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:22 devstack sudo[106792]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743.4fce31c9-7196-43a0-bc93-6b325061aa5a" returned: 0 in 0.321s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-4fce31c9-7196-43a0-bc93-6b325061aa5a" released by "_delete_snapshot" :: held 1.919s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-a03fe5b0-5b54-4544-a121-794a48bae743" released by "delete_snapshot" :: held 1.945s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Created reservations ['b364a928-e5c7-4c75-adc9-632348dba7dc', '174705f9-6aa2-4d80-aeb2-f1dd91efb8da', 'fc8b0e97-7409-443c-bd31-7e0ec1061887', 'ea75c51e-a0b4-43b8-a4b6-bb92e24251fd'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:22 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-563de4b3-1d8a-48d3-b5f3-7c8f861facb5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-4fce31c9-7196-43a0-bc93-6b325061aa5a-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-a03fe5b0-5b54-4544-a121-794a48bae743-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-a03fe5b0-5b54-4544-a121-794a48bae743-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-a03fe5b0-5b54-4544-a121-794a48bae743" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-a03fe5b0-5b54-4544-a121-794a48bae743" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6436af17-c13c-4a8b-8cd3-40d8e6596e35]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (bb375d32-82d8-4996-9f99-6a843c6abf12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5209e8f5-445c-4627-a12c-e0a272442846) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5209e8f5-445c-4627-a12c-e0a272442846) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696342476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb1190-b706-46f4-baee-b3ce60a2eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:23Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310de82d-c971-4ab8-8eda-14c1b1b65564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (310de82d-c971-4ab8-8eda-14c1b1b65564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffb03cb-1d00-4cb7-96e3-6dd9928e332c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ffb03cb-1d00-4cb7-96e3-6dd9928e332c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87bb1190-b706-46f4-baee-b3ce60a2eb85', 'volume_name': 'volume-87bb1190-b706-46f4-baee-b3ce60a2eb85', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80493156-1cce-49ee-9739-c7ec14cdd73f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80493156-1cce-49ee-9739-c7ec14cdd73f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:22 devstack sudo[106796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 Sep 18 00:52:22 devstack sudo[106796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4174fc5-43cf-4189-aaed-49208621f309) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:22 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Volume 87bb1190-b706-46f4-baee-b3ce60a2eb85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87bb1190-b706-46f4-baee-b3ce60a2eb85', 'volume_size': 1} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1696342476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87bb1190-b706-46f4-baee-b3ce60a2eb85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:23Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Creating volume 87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:22 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:22 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:22 devstack sudo[106798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 1073741824 Sep 18 00:52:22 devstack sudo[106798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:23 devstack sudo[106796]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743" returned: 0 in 0.503s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:23 devstack sudo[106807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743 Sep 18 00:52:23 devstack sudo[106807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:23 devstack sudo[106798]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 1073741824" returned: 0 in 0.565s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:23 devstack sudo[106810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 Sep 18 00:52:23 devstack sudo[106810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:23 devstack sudo[106807]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a03fe5b0-5b54-4544-a121-794a48bae743" returned: 0 in 0.337s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-a03fe5b0-5b54-4544-a121-794a48bae743" released by "delete_volume" :: held 0.937s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Created reservations ['7fa115d1-b6ad-4066-8e20-65875d8a45fc', 'a7fb5dba-61e8-44fc-8729-ebb85595fc3a', '252fdae6-0e1e-451b-9d18-929859837db3', '28a7bb53-3fea-4e83-af7b-018ed9ff9f5e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:23 devstack sudo[106813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:23 devstack sudo[106813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:23 devstack sudo[106810]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85" returned: 0 in 0.403s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] <== create_volume: return (1042ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.045s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f4174fc5-43cf-4189-aaed-49208621f309) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87bb1190-b706-46f4-baee-b3ce60a2eb85', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7982aba6-08e4-4d0f-8456-f88540ef1f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:23 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Volume volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 (87bb1190-b706-46f4-baee-b3ce60a2eb85): created successfully Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7982aba6-08e4-4d0f-8456-f88540ef1f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (bb375d32-82d8-4996-9f99-6a843c6abf12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:23 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8642329b-2141-49ce-81f2-9ebea23a2202 tempest-ProjectReaderTests-636043275 None] Created volume successfully. Sep 18 00:52:23 devstack sudo[106813]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:23 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-23662148-8b79-450b-8aba-c135065e6563 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-a03fe5b0-5b54-4544-a121-794a48bae743-delete_volume" released by "delete_volume" :: held 1.608s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (7ef78569-b686-4bb6-a060-3e4b62b99654) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfe4a49-1c35-497e-900f-60c8e6fbfc18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbfe4a49-1c35-497e-900f-60c8e6fbfc18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564519060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46f3746-a380-4bd6-8b1c-e0171f120f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:24Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9533b3b0-ed99-4227-97fd-a29e79241f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9533b3b0-ed99-4227-97fd-a29e79241f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8feac1-d34f-4cb2-8db9-8ec6245c02d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef8feac1-d34f-4cb2-8db9-8ec6245c02d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f46f3746-a380-4bd6-8b1c-e0171f120f87', 'volume_name': 'volume-f46f3746-a380-4bd6-8b1c-e0171f120f87', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7db234-d637-478c-8f0f-0bc7d03e3f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8b7db234-d637-478c-8f0f-0bc7d03e3f61) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f04630-2f51-450e-ab71-90684063c0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:24 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Volume f46f3746-a380-4bd6-8b1c-e0171f120f87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f46f3746-a380-4bd6-8b1c-e0171f120f87', 'volume_size': 1} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1564519060',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f46f3746-a380-4bd6-8b1c-e0171f120f87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:24Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Creating volume f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:24 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:24 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 1073741824 Sep 18 00:52:24 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:24 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 1073741824" returned: 0 in 0.547s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:24 devstack sudo[106823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 Sep 18 00:52:24 devstack sudo[106823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:25 devstack sudo[106823]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (859ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.281s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (43f04630-2f51-450e-ab71-90684063c0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f46f3746-a380-4bd6-8b1c-e0171f120f87', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11c5cd6-8f56-4dc2-a831-edf8bef7f67d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Creating offline snapshot 09c50c6b-4830-4f46-9305-fa0bede4bcf1 of volume 87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:25 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Volume volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 (f46f3746-a380-4bd6-8b1c-e0171f120f87): created successfully Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c11c5cd6-8f56-4dc2-a831-edf8bef7f67d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (7ef78569-b686-4bb6-a060-3e4b62b99654) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[8df8b623-b686-4bcd-9600-6437a8394fcc]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:25 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-58da366a-8335-40b1-a9a4-4a99ded3539d tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:52:25 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 Sep 18 00:52:25 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:25 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:25 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:25 devstack sudo[106831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 1G Sep 18 00:52:25 devstack sudo[106831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:26 devstack sudo[106831]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 1G" returned: 0 in 0.453s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:26 devstack sudo[106836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 Sep 18 00:52:26 devstack sudo[106836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:26 devstack sudo[106836]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1" returned: 0 in 0.340s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:26 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 is being set with open permissions: ugo+rw Sep 18 00:52:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:26 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 Sep 18 00:52:26 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:26 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1" returned: 0 in 0.274s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:26 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:26 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.info Sep 18 00:52:26 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:27 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.info" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:27 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.info is being set with open permissions: ugo+rw Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:27 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.info Sep 18 00:52:27 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:27 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.info" returned: 0 in 0.246s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.091s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.792s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot d68d65d6-5b10-487c-9854-97b12241759b of volume f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:27 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-58c5a741-9287-4ffa-9e1b-7df6afacd915 tempest-ProjectReaderTests-636043275 None] Create snapshot completed successfully Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba0f7a24-104a-4f77-887b-0e324cb7b55a]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:27 devstack sudo[106850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 Sep 18 00:52:27 devstack sudo[106850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:27 devstack sudo[106850]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:27 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:27 devstack sudo[106855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b 1G Sep 18 00:52:27 devstack sudo[106855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-09c50c6b-4830-4f46-9305-fa0bede4bcf1-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Lock "cinder-09c50c6b-4830-4f46-9305-fa0bede4bcf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-87bb1190-b706-46f4-baee-b3ce60a2eb85" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-87bb1190-b706-46f4-baee-b3ce60a2eb85" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-09c50c6b-4830-4f46-9305-fa0bede4bcf1" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-09c50c6b-4830-4f46-9305-fa0bede4bcf1" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Deleting offline snapshot 09c50c6b-4830-4f46-9305-fa0bede4bcf1 of volume 87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] snapshot_file for this snap is: volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ded6a2-083f-4bae-a0f8-1bcc80cbb352]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:28 devstack sudo[106855]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b 1G" returned: 0 in 0.505s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:28 devstack sudo[106862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b Sep 18 00:52:28 devstack sudo[106862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:28 devstack sudo[106861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 Sep 18 00:52:28 devstack sudo[106861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:28 devstack sudo[106862]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b" returned: 0 in 0.366s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:28 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b is being set with open permissions: ugo+rw Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:28 devstack sudo[106861]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1" returned: 0 in 0.410s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-87bb1190-b706-46f4-baee-b3ce60a2eb85(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:28 devstack sudo[106872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b Sep 18 00:52:28 devstack sudo[106872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef9e0d58-7be9-47f2-b8c2-5a35ab8e245c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:28 devstack sudo[106874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 Sep 18 00:52:28 devstack sudo[106874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:28 devstack sudo[106872]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:28 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:28 devstack sudo[106877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.info Sep 18 00:52:28 devstack sudo[106877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:29 devstack sudo[106874]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85" returned: 0 in 0.409s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:29 devstack sudo[106883]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 Sep 18 00:52:29 devstack sudo[106883]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:29 devstack sudo[106877]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.info" returned: 0 in 0.310s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:29 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.info is being set with open permissions: ugo+rw Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:29 devstack sudo[106886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.info Sep 18 00:52:29 devstack sudo[106886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:29 devstack sudo[106883]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1" returned: 0 in 0.414s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:29 devstack sudo[106886]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.info" returned: 0 in 0.269s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:29 devstack sudo[106892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1 Sep 18 00:52:29 devstack sudo[106892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.249s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b1eee80b-a5ff-48e9-8656-8357cf91d6f1 tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:52:29 devstack sudo[106892]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85.09c50c6b-4830-4f46-9305-fa0bede4bcf1" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-09c50c6b-4830-4f46-9305-fa0bede4bcf1" released by "_delete_snapshot" :: held 1.627s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-87bb1190-b706-46f4-baee-b3ce60a2eb85" released by "delete_snapshot" :: held 1.651s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Created reservations ['4eb74512-2b1f-4146-bdd3-f76d38315003', '9c822a09-bf8d-4bd6-ab4d-ed94018a1b8d', 'b6f6570d-ba41-4f12-9bda-b051503e34a6', '19951bec-5153-4060-bcb4-1ac0b5072b6e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:29 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Delete snapshot completed successfully. Sep 18 00:52:29 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-7f756e6a-a3ce-4d5a-951a-15f2b1150c6c tempest-ProjectReaderTests-636043275 None] Lock "cinder-09c50c6b-4830-4f46-9305-fa0bede4bcf1-delete_snapshot" released by "delete_snapshot" :: held 1.800s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-87bb1190-b706-46f4-baee-b3ce60a2eb85-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Lock "cinder-87bb1190-b706-46f4-baee-b3ce60a2eb85-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-87bb1190-b706-46f4-baee-b3ce60a2eb85" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-87bb1190-b706-46f4-baee-b3ce60a2eb85" acquired by "delete_volume" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd875822-e79d-4fb1-946a-063fca10bb1d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:30 devstack sudo[106895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 Sep 18 00:52:30 devstack sudo[106895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-d68d65d6-5b10-487c-9854-97b12241759b-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-d68d65d6-5b10-487c-9854-97b12241759b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-f46f3746-a380-4bd6-8b1c-e0171f120f87" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-f46f3746-a380-4bd6-8b1c-e0171f120f87" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-d68d65d6-5b10-487c-9854-97b12241759b" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d68d65d6-5b10-487c-9854-97b12241759b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot d68d65d6-5b10-487c-9854-97b12241759b of volume f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[be90414f-821f-46bb-bddb-c9f6657f639e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:30 devstack sudo[106895]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:30 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:30 devstack sudo[106901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85 Sep 18 00:52:30 devstack sudo[106901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:30 devstack sudo[106900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b Sep 18 00:52:30 devstack sudo[106900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:31 devstack sudo[106901]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-87bb1190-b706-46f4-baee-b3ce60a2eb85" returned: 0 in 0.283s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-87bb1190-b706-46f4-baee-b3ce60a2eb85" released by "delete_volume" :: held 0.795s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Created reservations ['13306e17-58ce-4a69-8af6-522c01a632b7', 'f990e07a-aec5-481e-8b33-e2b3948df0bb', '898d5ef1-a5b1-4346-8ca5-155c1c77de8c', '9405f9d6-3ad9-4328-a527-de0ed8fdcd05'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:31 devstack sudo[106900]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b" returned: 0 in 0.440s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f46f3746-a380-4bd6-8b1c-e0171f120f87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c0d702d-a1b5-4636-8aae-0572ea5d1c76]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:31 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:31 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:31 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 Sep 18 00:52:31 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:31 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.377s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:31 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Deleted volume successfully. Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1917f7e3-db3c-4a37-bb4b-e83ffc9791f6 tempest-ProjectReaderTests-636043275 None] Lock "cinder-87bb1190-b706-46f4-baee-b3ce60a2eb85-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:31 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87" returned: 0 in 0.511s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:31 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:31 devstack sudo[106920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b Sep 18 00:52:31 devstack sudo[106920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (a1a3e4e8-f47b-4f90-a033-3aa7d20bde06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6fafe7-33f7-485d-8f3b-48e83486fb94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b6fafe7-33f7-485d-8f3b-48e83486fb94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958891974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f306f74a-0241-4f92-a1e3-241109acf227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:32Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c5a3cf-e115-4c33-9c14-ceb4d3bbaead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1c5a3cf-e115-4c33-9c14-ceb4d3bbaead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1edf18-3278-4c70-83ec-2d3670d449bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1a1edf18-3278-4c70-83ec-2d3670d449bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f306f74a-0241-4f92-a1e3-241109acf227', 'volume_name': 'volume-f306f74a-0241-4f92-a1e3-241109acf227', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233b0ab3-e98c-48da-b57c-681144f24dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (233b0ab3-e98c-48da-b57c-681144f24dfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7090b9fc-c13e-4105-8fd8-3dc49f2f4999) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:32 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Volume f306f74a-0241-4f92-a1e3-241109acf227: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f306f74a-0241-4f92-a1e3-241109acf227', 'volume_size': 1} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1958891974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f306f74a-0241-4f92-a1e3-241109acf227,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:32Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Creating volume f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:32 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:32 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 1073741824 Sep 18 00:52:32 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:32 devstack sudo[106920]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b" returned: 0 in 0.437s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:32 devstack sudo[106927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b Sep 18 00:52:32 devstack sudo[106927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:32 devstack sudo[106927]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87.d68d65d6-5b10-487c-9854-97b12241759b" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d68d65d6-5b10-487c-9854-97b12241759b" released by "_delete_snapshot" :: held 1.768s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-f46f3746-a380-4bd6-8b1c-e0171f120f87" released by "delete_snapshot" :: held 1.803s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:32 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 1073741824" returned: 0 in 0.479s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Created reservations ['fe434578-2dc2-46de-8cfe-0cda9aaf8abe', '12ff0a55-6bcf-4a6c-b997-1648cb366aaf', '3c143809-38d2-4ea1-8874-c657c8c05fd4', '5e4a62af-a9b3-4587-b770-916c0ab4f35f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:32 devstack sudo[106934]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 Sep 18 00:52:32 devstack sudo[106934]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:32 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ab727426-7529-4263-982e-927ad1a6dec2 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-d68d65d6-5b10-487c-9854-97b12241759b-delete_snapshot" released by "delete_snapshot" :: held 2.005s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-f46f3746-a380-4bd6-8b1c-e0171f120f87-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:32 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-f46f3746-a380-4bd6-8b1c-e0171f120f87-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:33 devstack sudo[106934]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227" returned: 0 in 0.328s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7090b9fc-c13e-4105-8fd8-3dc49f2f4999) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f306f74a-0241-4f92-a1e3-241109acf227', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9530748-ca73-4f41-8ada-3a0caf57c422) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-f46f3746-a380-4bd6-8b1c-e0171f120f87" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:33 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Volume volume-f306f74a-0241-4f92-a1e3-241109acf227 (f306f74a-0241-4f92-a1e3-241109acf227): created successfully Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9530748-ca73-4f41-8ada-3a0caf57c422) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (a1a3e4e8-f47b-4f90-a033-3aa7d20bde06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-f46f3746-a380-4bd6-8b1c-e0171f120f87" acquired by "delete_volume" :: waited 0.030s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:33 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-b1d6e39b-cb13-4d45-86f3-4533935ecbe3 tempest-ProjectReaderTests-636043275 None] Created volume successfully. Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6395cdd6-e778-487b-a7f1-818ec2ac3632]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:33 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 Sep 18 00:52:33 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:33 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87" returned: 0 in 0.386s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:33 devstack sudo[106943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87 Sep 18 00:52:33 devstack sudo[106943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:33 devstack sudo[106943]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f46f3746-a380-4bd6-8b1c-e0171f120f87" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-f46f3746-a380-4bd6-8b1c-e0171f120f87" released by "delete_volume" :: held 0.723s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Created reservations ['295b3fae-86a5-48eb-b508-6c2d544fb908', '6deebb13-60d7-4099-ba0b-7c7e815f88e7', '35e1b042-7197-4529-8306-fecbb99d9937', '472339c7-9959-4847-b818-3bbe785620ad'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:33 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:33 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:33 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:34 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.271s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:34 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-8e3f265f-c606-4cf8-8661-32ee1ab19fc5 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-f46f3746-a380-4bd6-8b1c-e0171f120f87-delete_volume" released by "delete_volume" :: held 1.285s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Creating offline snapshot 45f0edf6-72e1-49a0-962a-2db9d6b6a39a of volume f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a658b829-3314-480b-a8e2-457ac88e3400]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:34 devstack sudo[106949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 Sep 18 00:52:34 devstack sudo[106949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (d1088ea5-02da-4b74-b951-78f153c6ae7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44c3250-14f8-4317-b8c3-925a813d2379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b44c3250-14f8-4317-b8c3-925a813d2379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302496850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf436cc-cb89-42f3-bc24-76989627d1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:35Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c8e3a5-7502-46c0-820e-65a72aa8f8eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32c8e3a5-7502-46c0-820e-65a72aa8f8eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e005d72-0e5a-4aa1-b56d-a384536b782f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9e005d72-0e5a-4aa1-b56d-a384536b782f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaf436cc-cb89-42f3-bc24-76989627d1c6', 'volume_name': 'volume-eaf436cc-cb89-42f3-bc24-76989627d1c6', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31670c86-cbe1-4ac8-8e80-4139ccee3a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31670c86-cbe1-4ac8-8e80-4139ccee3a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6002e8-65f4-43f4-8ad1-f151175fd9fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:34 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Volume eaf436cc-cb89-42f3-bc24-76989627d1c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaf436cc-cb89-42f3-bc24-76989627d1c6', 'volume_size': 1} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:34 devstack sudo[106949]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227" returned: 0 in 0.403s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:34 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:34 devstack sudo[106954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a 1G Sep 18 00:52:34 devstack sudo[106954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:35 devstack sudo[106954]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a 1G" returned: 0 in 0.412s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f306f74a-0241-4f92-a1e3-241109acf227 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:35 devstack sudo[106960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f306f74a-0241-4f92-a1e3-241109acf227 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a Sep 18 00:52:35 devstack sudo[106960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:35 devstack sudo[106960]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f306f74a-0241-4f92-a1e3-241109acf227 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a" returned: 0 in 0.311s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:35 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a is being set with open permissions: ugo+rw Sep 18 00:52:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:35 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a Sep 18 00:52:35 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:35 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:35 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:35 devstack sudo[106968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.info Sep 18 00:52:35 devstack sudo[106968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:36 devstack sudo[106968]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.info" returned: 0 in 0.285s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:36 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.info is being set with open permissions: ugo+rw Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:36 devstack sudo[106972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.info Sep 18 00:52:36 devstack sudo[106972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:36 devstack sudo[106972]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.info" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.043s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.736s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1302496850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaf436cc-cb89-42f3-bc24-76989627d1c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:35Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Creating volume eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:36 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:36 devstack sudo[106975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 1073741824 Sep 18 00:52:36 devstack sudo[106975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:36 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-dca68c43-8120-4043-af59-3c3ead07432e tempest-ProjectReaderTests-636043275 None] Create snapshot completed successfully Sep 18 00:52:36 devstack sudo[106975]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:36 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 1073741824" returned: 0 in 0.490s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:37 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 Sep 18 00:52:37 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:37 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (793ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c6002e8-65f4-43f4-8ad1-f151175fd9fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaf436cc-cb89-42f3-bc24-76989627d1c6', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4054cc3c-9571-4d02-a73f-10f8e940b93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:37 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Volume volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 (eaf436cc-cb89-42f3-bc24-76989627d1c6): created successfully Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4054cc3c-9571-4d02-a73f-10f8e940b93d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (d1088ea5-02da-4b74-b951-78f153c6ae7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:37 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a7a46172-5023-4cbc-9124-e0c579cf0880 tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-45f0edf6-72e1-49a0-962a-2db9d6b6a39a-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Lock "cinder-45f0edf6-72e1-49a0-962a-2db9d6b6a39a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-f306f74a-0241-4f92-a1e3-241109acf227" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-f306f74a-0241-4f92-a1e3-241109acf227" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-45f0edf6-72e1-49a0-962a-2db9d6b6a39a" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-45f0edf6-72e1-49a0-962a-2db9d6b6a39a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Deleting offline snapshot 45f0edf6-72e1-49a0-962a-2db9d6b6a39a of volume f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] snapshot_file for this snap is: volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[48d6285a-0a4f-4c63-bf5d-1d8a794928b4]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:37 devstack sudo[106984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a Sep 18 00:52:37 devstack sudo[106984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:37 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot 1aa5db5c-c82b-4cbc-9eac-062f098e7903 of volume eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c38bde14-b4a6-4916-9f75-1a2725929a83]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:38 devstack sudo[106984]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a" returned: 0 in 0.413s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f306f74a-0241-4f92-a1e3-241109acf227(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:38 devstack sudo[106986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 Sep 18 00:52:38 devstack sudo[106986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[78105d3e-d9e0-486f-b002-aad65a7ac193]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:38 devstack sudo[106991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 Sep 18 00:52:38 devstack sudo[106991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:38 devstack sudo[106986]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6" returned: 0 in 0.414s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:38 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 1G Sep 18 00:52:38 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:38 devstack sudo[106991]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227" returned: 0 in 0.409s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:38 devstack sudo[107001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a Sep 18 00:52:38 devstack sudo[107001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:38 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 1G" returned: 0 in 0.481s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:38 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:38 devstack sudo[107014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 Sep 18 00:52:38 devstack sudo[107014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:39 devstack sudo[107001]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a" returned: 0 in 0.452s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:39 devstack sudo[107016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a Sep 18 00:52:39 devstack sudo[107016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:39 devstack sudo[107014]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903" returned: 0 in 0.333s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:39 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 is being set with open permissions: ugo+rw Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:39 devstack sudo[107022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 Sep 18 00:52:39 devstack sudo[107022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:39 devstack sudo[107016]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227.45f0edf6-72e1-49a0-962a-2db9d6b6a39a" returned: 0 in 0.302s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-45f0edf6-72e1-49a0-962a-2db9d6b6a39a" released by "_delete_snapshot" :: held 1.706s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-f306f74a-0241-4f92-a1e3-241109acf227" released by "delete_snapshot" :: held 1.730s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Created reservations ['ffc55177-5bf6-4477-8722-78f15a66170f', '8670251c-2e7f-46ce-a529-caa9f8d4a296', 'c013c1ae-6f75-4b26-9bc9-911011365b91', 'dd95cdc6-7c7e-4e76-b604-6116bbe02b6b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:39 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Delete snapshot completed successfully. Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-c9bac1ab-d328-4279-a6a5-3c2acbcf9975 tempest-ProjectReaderTests-636043275 None] Lock "cinder-45f0edf6-72e1-49a0-962a-2db9d6b6a39a-delete_snapshot" released by "delete_snapshot" :: held 1.885s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:39 devstack sudo[107022]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:39 devstack sudo[107026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.info Sep 18 00:52:39 devstack sudo[107026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-f306f74a-0241-4f92-a1e3-241109acf227-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Lock "cinder-f306f74a-0241-4f92-a1e3-241109acf227-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:39 devstack sudo[107026]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-f306f74a-0241-4f92-a1e3-241109acf227" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.info" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:39 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.info is being set with open permissions: ugo+rw Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-f306f74a-0241-4f92-a1e3-241109acf227" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:39 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.info Sep 18 00:52:39 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad498bcb-52e1-4d19-b6b2-9d78d0ee641e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:39 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:40 devstack sudo[107031]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 Sep 18 00:52:40 devstack sudo[107031]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:40 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.info" returned: 0 in 0.253s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ed13a67c-3aa3-432a-bfb9-765eaf052b74 tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:52:40 devstack sudo[107031]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227" returned: 0 in 0.364s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:40 devstack sudo[107037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227 Sep 18 00:52:40 devstack sudo[107037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:40 devstack sudo[107037]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-f306f74a-0241-4f92-a1e3-241109acf227" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-f306f74a-0241-4f92-a1e3-241109acf227" released by "delete_volume" :: held 0.680s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Created reservations ['5a550eca-3405-4e23-8acc-360928299551', '1d49cf22-051e-4797-abf7-ece77ce70062', '4120887b-0c04-4d12-8c2b-4d39edf9b309', '2dd91cac-3d56-4d87-8338-cbe397d8a6d1'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:40 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:40 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:40 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:40 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Deleted volume successfully. Sep 18 00:52:40 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-4a83f6fa-7ec7-47f5-9cbe-b4e23b9e0bf8 tempest-ProjectReaderTests-636043275 None] Lock "cinder-f306f74a-0241-4f92-a1e3-241109acf227-delete_volume" released by "delete_volume" :: held 1.141s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-1aa5db5c-c82b-4cbc-9eac-062f098e7903-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-1aa5db5c-c82b-4cbc-9eac-062f098e7903-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-eaf436cc-cb89-42f3-bc24-76989627d1c6" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-eaf436cc-cb89-42f3-bc24-76989627d1c6" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-1aa5db5c-c82b-4cbc-9eac-062f098e7903" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-1aa5db5c-c82b-4cbc-9eac-062f098e7903" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot 1aa5db5c-c82b-4cbc-9eac-062f098e7903 of volume eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c51b96cf-a59a-47d9-8908-c239d2443c7f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:41 devstack sudo[107044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 Sep 18 00:52:41 devstack sudo[107044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (e779dc78-59dd-4d42-b980-d30d93311939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18cd017-e06b-423c-990b-bd0b7771008a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e18cd017-e06b-423c-990b-bd0b7771008a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79517992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05eaa90d-985b-4f96-9488-d7a895edf870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:41Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5421e6b-e12f-4a3c-9de2-92b28e6d5177) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5421e6b-e12f-4a3c-9de2-92b28e6d5177) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e388b982-dbbe-4b2b-bfda-dc2f35a9b3a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e388b982-dbbe-4b2b-bfda-dc2f35a9b3a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05eaa90d-985b-4f96-9488-d7a895edf870', 'volume_name': 'volume-05eaa90d-985b-4f96-9488-d7a895edf870', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c061204-43c7-47c7-b266-587c6135cd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c061204-43c7-47c7-b266-587c6135cd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849b2de7-8b29-4ff1-94db-e4fda3af012b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:41 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Volume 05eaa90d-985b-4f96-9488-d7a895edf870: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05eaa90d-985b-4f96-9488-d7a895edf870', 'volume_size': 1} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-79517992',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05eaa90d-985b-4f96-9488-d7a895edf870,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:41Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Creating volume 05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:41 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:41 devstack sudo[107046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 1073741824 Sep 18 00:52:41 devstack sudo[107046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:41 devstack sudo[107044]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903" returned: 0 in 0.394s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaf436cc-cb89-42f3-bc24-76989627d1c6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdb325db-74fc-4198-8d87-d3267136f30f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:41 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 Sep 18 00:52:41 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:41 devstack sudo[107046]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 1073741824" returned: 0 in 0.422s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:41 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:41 devstack sudo[107056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 Sep 18 00:52:41 devstack sudo[107056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:42 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6" returned: 0 in 0.395s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:42 devstack sudo[107061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 Sep 18 00:52:42 devstack sudo[107061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:42 devstack sudo[107056]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (849b2de7-8b29-4ff1-94db-e4fda3af012b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05eaa90d-985b-4f96-9488-d7a895edf870', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2eebb9d-da19-4884-ab0b-e98b244747bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:42 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Volume volume-05eaa90d-985b-4f96-9488-d7a895edf870 (05eaa90d-985b-4f96-9488-d7a895edf870): created successfully Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2eebb9d-da19-4884-ab0b-e98b244747bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (e779dc78-59dd-4d42-b980-d30d93311939) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-042adffd-e71e-465f-af46-ed56502bb6d8 tempest-ProjectReaderTests-636043275 None] Created volume successfully. Sep 18 00:52:42 devstack sudo[107061]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903" returned: 0 in 0.355s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:42 devstack sudo[107067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903 Sep 18 00:52:42 devstack sudo[107067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Creating offline snapshot e0fca692-e14c-410c-8ba1-00c0598c0f30 of volume 05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[984f40fd-0d4d-4087-81f2-43a3c392b551]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:42 devstack sudo[107067]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6.1aa5db5c-c82b-4cbc-9eac-062f098e7903" returned: 0 in 0.271s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:42 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-1aa5db5c-c82b-4cbc-9eac-062f098e7903" released by "_delete_snapshot" :: held 1.539s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:42 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-eaf436cc-cb89-42f3-bc24-76989627d1c6" released by "delete_snapshot" :: held 1.563s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Created reservations ['ff7252f5-df67-44d1-9f4a-f72b9e2cb078', '27b73c39-4c54-40e1-acf6-75577d7a37fe', '8c3c021b-d62f-432d-9401-8023f8a99e79', '5587166e-3ca3-4513-8dd1-aef7fb1335bf'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:42 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-21f31443-6114-449c-9ef9-bff643d59806 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-1aa5db5c-c82b-4cbc-9eac-062f098e7903-delete_snapshot" released by "delete_snapshot" :: held 1.698s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:42 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870" returned: 0 in 0.373s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:42 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:43 devstack sudo[107075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 1G Sep 18 00:52:43 devstack sudo[107075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-eaf436cc-cb89-42f3-bc24-76989627d1c6-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Lock "cinder-eaf436cc-cb89-42f3-bc24-76989627d1c6-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-eaf436cc-cb89-42f3-bc24-76989627d1c6" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-eaf436cc-cb89-42f3-bc24-76989627d1c6" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4bd8d1b1-498f-481b-be22-d812431d36ba]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:43 devstack sudo[107075]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 1G" returned: 0 in 0.474s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05eaa90d-985b-4f96-9488-d7a895edf870 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:43 devstack sudo[107081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05eaa90d-985b-4f96-9488-d7a895edf870 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 Sep 18 00:52:43 devstack sudo[107081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:43 devstack sudo[107080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 Sep 18 00:52:43 devstack sudo[107080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:43 devstack sudo[107081]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-05eaa90d-985b-4f96-9488-d7a895edf870 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30" returned: 0 in 0.293s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:43 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 is being set with open permissions: ugo+rw Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:43 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 Sep 18 00:52:43 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:43 devstack sudo[107080]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6" returned: 0 in 0.395s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:43 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:43 devstack sudo[107092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6 Sep 18 00:52:43 devstack sudo[107092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:44 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:44 devstack sudo[107096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.info Sep 18 00:52:44 devstack sudo[107096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:44 devstack sudo[107092]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-eaf436cc-cb89-42f3-bc24-76989627d1c6" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-eaf436cc-cb89-42f3-bc24-76989627d1c6" released by "delete_volume" :: held 0.728s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Created reservations ['47030635-4289-45ff-b2bf-e27c5d32b5a5', '4d90a004-4009-4ecb-828b-b9454c317984', '69f639a9-da4a-453d-9426-424d1b2ec1e7', '5dd98473-eaf7-4ca3-899c-4fe2478b27ee'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:44 devstack sudo[107098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:44 devstack sudo[107098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:44 devstack sudo[107096]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.info" returned: 0 in 0.274s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:44 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.info is being set with open permissions: ugo+rw Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:44 devstack sudo[107101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.info Sep 18 00:52:44 devstack sudo[107101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:44 devstack sudo[107098]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.265s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5c4973fa-2e1f-44b1-969b-67c0c27aa0fc tempest-ProjectMemberTests-1382227428 None] Lock "cinder-eaf436cc-cb89-42f3-bc24-76989627d1c6-delete_volume" released by "delete_volume" :: held 1.228s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:44 devstack sudo[107101]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.info" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.039s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:44 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1adf8e49-6067-44fa-9bf3-7364ba9df118 tempest-ProjectReaderTests-636043275 None] Create snapshot completed successfully Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (e4f158e5-f17a-4d78-ac85-75922366ba47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80708a19-a22c-4f4d-aba1-0144676fe24a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (80708a19-a22c-4f4d-aba1-0144676fe24a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515144263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b14f0a-4374-4d61-84f5-50399cb55d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:45Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f37bde-755d-4487-b295-4fc969061e25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a1f37bde-755d-4487-b295-4fc969061e25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742a2c6e-6cad-4dfe-9269-c04cb8ca31fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (742a2c6e-6cad-4dfe-9269-c04cb8ca31fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '50b14f0a-4374-4d61-84f5-50399cb55d01', 'volume_name': 'volume-50b14f0a-4374-4d61-84f5-50399cb55d01', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:44 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeba98cd-b54c-4c66-8ae3-d70d2d8b6599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aeba98cd-b54c-4c66-8ae3-d70d2d8b6599) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af59324f-b249-40e7-b14c-d05aae4b1504) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:45 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Volume 50b14f0a-4374-4d61-84f5-50399cb55d01: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-50b14f0a-4374-4d61-84f5-50399cb55d01', 'volume_size': 1} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1515144263',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=50b14f0a-4374-4d61-84f5-50399cb55d01,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:45Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Creating volume 50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:45 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:45 devstack sudo[107105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 1073741824 Sep 18 00:52:45 devstack sudo[107105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:45 devstack sudo[107105]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 1073741824" returned: 0 in 0.411s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:45 devstack sudo[107110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 Sep 18 00:52:45 devstack sudo[107110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:45 devstack sudo[107110]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (708ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.709s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af59324f-b249-40e7-b14c-d05aae4b1504) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-50b14f0a-4374-4d61-84f5-50399cb55d01', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556a7706-bb4c-4789-81df-370db60b032a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:45 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Volume volume-50b14f0a-4374-4d61-84f5-50399cb55d01 (50b14f0a-4374-4d61-84f5-50399cb55d01): created successfully Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (556a7706-bb4c-4789-81df-370db60b032a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (e4f158e5-f17a-4d78-ac85-75922366ba47) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-e0fca692-e14c-410c-8ba1-00c0598c0f30-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:45 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-c378fa4f-5828-4a20-80ee-d0820670e7df tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Lock "cinder-e0fca692-e14c-410c-8ba1-00c0598c0f30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-05eaa90d-985b-4f96-9488-d7a895edf870" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-05eaa90d-985b-4f96-9488-d7a895edf870" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-e0fca692-e14c-410c-8ba1-00c0598c0f30" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-e0fca692-e14c-410c-8ba1-00c0598c0f30" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Deleting offline snapshot e0fca692-e14c-410c-8ba1-00c0598c0f30 of volume 05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] snapshot_file for this snap is: volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d077d0-e7f0-4ef1-8bc4-521198592113]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:45 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:45 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 Sep 18 00:52:45 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot 561218ed-81b2-43f4-b844-10dd0ed06203 of volume 50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c788402-7f6e-4bd5-a88d-c8cecc3d6f70]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:46 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30" returned: 0 in 0.393s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-05eaa90d-985b-4f96-9488-d7a895edf870(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:46 devstack sudo[107115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc299dba-59bd-46f6-a02a-4d84f9c1ddc8]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:46 devstack sudo[107115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:46 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 Sep 18 00:52:46 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:46 devstack sudo[107115]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01" returned: 0 in 0.380s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:46 devstack sudo[107125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 1G Sep 18 00:52:46 devstack sudo[107125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:46 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870" returned: 0 in 0.369s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:46 devstack sudo[107130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 Sep 18 00:52:46 devstack sudo[107130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:46 devstack sudo[107125]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 1G" returned: 0 in 0.411s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:46 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b14f0a-4374-4d61-84f5-50399cb55d01 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:46 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b14f0a-4374-4d61-84f5-50399cb55d01 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 Sep 18 00:52:46 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:47 devstack sudo[107130]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30" returned: 0 in 0.381s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:47 devstack sudo[107140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30 Sep 18 00:52:47 devstack sudo[107140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:47 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-50b14f0a-4374-4d61-84f5-50399cb55d01 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203" returned: 0 in 0.293s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:47 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 is being set with open permissions: ugo+rw Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:47 devstack sudo[107146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 Sep 18 00:52:47 devstack sudo[107146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:47 devstack sudo[107140]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870.e0fca692-e14c-410c-8ba1-00c0598c0f30" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-e0fca692-e14c-410c-8ba1-00c0598c0f30" released by "_delete_snapshot" :: held 1.512s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-05eaa90d-985b-4f96-9488-d7a895edf870" released by "delete_snapshot" :: held 1.531s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Created reservations ['2948d4ae-79a7-435f-9102-9a38e7167afb', '1a8bacef-7f6d-4fb0-97c4-761cd7c89d86', '97c66cdb-2f12-487e-ac1c-6a539f89effe', '0a506a3b-13c1-4e76-aa45-fea88c09438c'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:47 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Delete snapshot completed successfully. Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f60a9e85-4f06-4b1d-bd51-3316a83a0a68 tempest-ProjectReaderTests-636043275 None] Lock "cinder-e0fca692-e14c-410c-8ba1-00c0598c0f30-delete_snapshot" released by "delete_snapshot" :: held 1.664s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:47 devstack sudo[107146]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:47 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.info Sep 18 00:52:47 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:47 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.info" returned: 0 in 0.247s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:47 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.info is being set with open permissions: ugo+rw Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:47 devstack sudo[107152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.info Sep 18 00:52:47 devstack sudo[107152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-05eaa90d-985b-4f96-9488-d7a895edf870-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Lock "cinder-05eaa90d-985b-4f96-9488-d7a895edf870-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:47 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-05eaa90d-985b-4f96-9488-d7a895edf870" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-05eaa90d-985b-4f96-9488-d7a895edf870" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:48 devstack sudo[107152]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.info" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.923s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d6830c7-45e2-4094-9ed3-13a4af96fdbd]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a70964fc-2008-4753-9de0-8fd7d9fbf0d8 tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:52:48 devstack sudo[107155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 Sep 18 00:52:48 devstack sudo[107155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-561218ed-81b2-43f4-b844-10dd0ed06203-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-561218ed-81b2-43f4-b844-10dd0ed06203-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-50b14f0a-4374-4d61-84f5-50399cb55d01" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-50b14f0a-4374-4d61-84f5-50399cb55d01" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-561218ed-81b2-43f4-b844-10dd0ed06203" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-561218ed-81b2-43f4-b844-10dd0ed06203" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot 561218ed-81b2-43f4-b844-10dd0ed06203 of volume 50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[a164756f-49fe-4d74-8e49-ca9448e16202]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:48 devstack sudo[107155]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870" returned: 0 in 0.390s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:48 devstack sudo[107157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 Sep 18 00:52:48 devstack sudo[107157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:48 devstack sudo[107161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870 Sep 18 00:52:48 devstack sudo[107161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:48 devstack sudo[107161]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-05eaa90d-985b-4f96-9488-d7a895edf870" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:48 devstack sudo[107157]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203" returned: 0 in 0.366s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-50b14f0a-4374-4d61-84f5-50399cb55d01(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-05eaa90d-985b-4f96-9488-d7a895edf870" released by "delete_volume" :: held 0.737s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b5c8b41-f3d4-4bd9-900c-6a668d25395e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Created reservations ['3b3d9546-ce2e-4df6-a93a-e1ea5634fd6c', '03f18085-fcb7-4116-87cf-44e830a1dea1', '4eeab4c3-168f-455e-9663-135e9eabbc61', 'e34fec51-9cb9-41cd-852c-821d97fe48a8'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:48 devstack sudo[107169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 Sep 18 00:52:48 devstack sudo[107169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:48 devstack sudo[107171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:48 devstack sudo[107171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:49 devstack sudo[107169]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01" returned: 0 in 0.371s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:49 devstack sudo[107171]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Deleted volume successfully. Sep 18 00:52:49 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 Sep 18 00:52:49 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-334d7a68-68dd-40ae-b974-c99562680e40 tempest-ProjectReaderTests-636043275 None] Lock "cinder-05eaa90d-985b-4f96-9488-d7a895edf870-delete_volume" released by "delete_volume" :: held 1.233s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:49 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203" returned: 0 in 0.390s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:49 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203 Sep 18 00:52:49 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (0520c79d-4081-4b84-aa13-0f2fa7995eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a192df-a869-42ba-b7af-16c1287d6cfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3a192df-a869-42ba-b7af-16c1287d6cfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917292447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c74e7-8ef6-4396-996a-4779bbc8c952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:50Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717d9154-f28a-4640-a03b-f5323c57af6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (717d9154-f28a-4640-a03b-f5323c57af6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31868d2-c630-4428-a457-511a240d4d4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d31868d2-c630-4428-a457-511a240d4d4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c73c74e7-8ef6-4396-996a-4779bbc8c952', 'volume_name': 'volume-c73c74e7-8ef6-4396-996a-4779bbc8c952', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda7a75b-86eb-4ea8-8b34-0427e2833d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eda7a75b-86eb-4ea8-8b34-0427e2833d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f1f223-6985-49c8-ba3d-0c80422d8b19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:49 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Volume c73c74e7-8ef6-4396-996a-4779bbc8c952: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c73c74e7-8ef6-4396-996a-4779bbc8c952', 'volume_size': 1} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-917292447',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c73c74e7-8ef6-4396-996a-4779bbc8c952,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f75f3a8fe4ce4aa19f8a26940173da16',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:50Z,use_quota=True,user_id='9c57d096ff4d4873bd16081718588bd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Creating volume c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:49 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:49 devstack sudo[107185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 1073741824 Sep 18 00:52:49 devstack sudo[107185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:49 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01.561218ed-81b2-43f4-b844-10dd0ed06203" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-561218ed-81b2-43f4-b844-10dd0ed06203" released by "_delete_snapshot" :: held 1.491s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-50b14f0a-4374-4d61-84f5-50399cb55d01" released by "delete_snapshot" :: held 1.517s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Created reservations ['edfc67c6-2737-441b-bcf8-e2af31403325', '0e18eeba-35c4-4d84-ad87-614d55ed9779', '92de8585-fcce-459e-8e6f-fbbc58830854', '11f91d5d-ef4e-43e3-b27e-5e95b33c24ea'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:49 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:52:49 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-1358c2be-ab7f-42a3-9ab4-451b4f81e687 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-561218ed-81b2-43f4-b844-10dd0ed06203-delete_snapshot" released by "delete_snapshot" :: held 1.656s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:50 devstack sudo[107185]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 1073741824" returned: 0 in 0.444s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:50 devstack sudo[107192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 Sep 18 00:52:50 devstack sudo[107192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:50 devstack sudo[107192]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] <== create_volume: return (732ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.735s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d9f1f223-6985-49c8-ba3d-0c80422d8b19) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c73c74e7-8ef6-4396-996a-4779bbc8c952', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a98858-dd02-4f95-ba7e-7e02f807130b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:50 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Volume volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 (c73c74e7-8ef6-4396-996a-4779bbc8c952): created successfully Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2a98858-dd02-4f95-ba7e-7e02f807130b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Flow 'volume_create_manager' (0520c79d-4081-4b84-aa13-0f2fa7995eb8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-50b14f0a-4374-4d61-84f5-50399cb55d01-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:50 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f542d66a-1b38-42fe-82ea-7fab0b68f4fc tempest-ProjectReaderTests-636043275 None] Created volume successfully. Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-50b14f0a-4374-4d61-84f5-50399cb55d01-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-50b14f0a-4374-4d61-84f5-50399cb55d01" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-50b14f0a-4374-4d61-84f5-50399cb55d01" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5a33658-820f-4620-84d0-ae0c7e1d1b29]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:50 devstack sudo[107195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 Sep 18 00:52:50 devstack sudo[107195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Creating offline snapshot 99d8d44c-b683-4735-a372-2142f240dd27 of volume c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f67fea2b-c002-4ca1-a84d-229c3d927e03]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:50 devstack sudo[107197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 Sep 18 00:52:50 devstack sudo[107197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:50 devstack sudo[107195]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01" returned: 0 in 0.400s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:50 devstack sudo[107202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01 Sep 18 00:52:50 devstack sudo[107202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:51 devstack sudo[107197]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952" returned: 0 in 0.360s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:51 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 1G Sep 18 00:52:51 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:51 devstack sudo[107202]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-50b14f0a-4374-4d61-84f5-50399cb55d01" returned: 0 in 0.253s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-50b14f0a-4374-4d61-84f5-50399cb55d01" released by "delete_volume" :: held 0.720s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Created reservations ['4836552c-65c3-4fa0-9d9f-d08fda5f9df1', 'a208e5e2-2577-4ca0-8764-0923edb2bf6e', '55296924-a163-43e7-ba04-392120a95b6b', 'fa273909-e4e2-4b1e-929a-baa2f961f59b'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:51 devstack sudo[107211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:51 devstack sudo[107211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:51 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 1G" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:51 devstack sudo[107217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 Sep 18 00:52:51 devstack sudo[107217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:51 devstack sudo[107211]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-47a30488-1a9d-47c2-8ff8-877272b1f844 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-50b14f0a-4374-4d61-84f5-50399cb55d01-delete_volume" released by "delete_volume" :: held 1.212s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:51 devstack sudo[107217]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27" returned: 0 in 0.319s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:51 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 is being set with open permissions: ugo+rw Sep 18 00:52:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:51 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 Sep 18 00:52:51 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (8f523db1-d1d7-484b-a95e-10a58d65101e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7d83e6-2e0a-4678-9cb6-6a6c83bbfd77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d7d83e6-2e0a-4678-9cb6-6a6c83bbfd77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787360199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69b9686-9212-40b8-b14a-85236d9920f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:52Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5987e3ad-8e6c-47fa-8fe8-46ba60f65ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5987e3ad-8e6c-47fa-8fe8-46ba60f65ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ab068d-7e7a-4f39-8ecf-65f00064e3a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81ab068d-7e7a-4f39-8ecf-65f00064e3a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd69b9686-9212-40b8-b14a-85236d9920f5', 'volume_name': 'volume-d69b9686-9212-40b8-b14a-85236d9920f5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795961b4-088f-4254-8fc5-76ee3c371f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (795961b4-088f-4254-8fc5-76ee3c371f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5b1afc-db18-424b-9221-f87a8a740901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:52 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Volume d69b9686-9212-40b8-b14a-85236d9920f5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d69b9686-9212-40b8-b14a-85236d9920f5', 'volume_size': 1} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:52 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27" returned: 0 in 0.253s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:52 devstack sudo[107226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.info Sep 18 00:52:52 devstack sudo[107226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:52 devstack sudo[107226]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.info" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:52 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.info is being set with open permissions: ugo+rw Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:52 devstack sudo[107229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.info Sep 18 00:52:52 devstack sudo[107229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:52 devstack sudo[107229]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.info" returned: 0 in 0.243s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.936s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.561s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:52:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-787360199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d69b9686-9212-40b8-b14a-85236d9920f5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:52:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:52:52Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Creating volume d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:52:52 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:52 devstack sudo[107232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 1073741824 Sep 18 00:52:52 devstack sudo[107232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:52 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-87049a83-1f0c-4eba-9ed2-9f8ff28d02a8 tempest-ProjectReaderTests-636043275 None] Create snapshot completed successfully Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-99d8d44c-b683-4735-a372-2142f240dd27-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Lock "cinder-99d8d44c-b683-4735-a372-2142f240dd27-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-c73c74e7-8ef6-4396-996a-4779bbc8c952" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-c73c74e7-8ef6-4396-996a-4779bbc8c952" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-99d8d44c-b683-4735-a372-2142f240dd27" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-99d8d44c-b683-4735-a372-2142f240dd27" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Deleting offline snapshot 99d8d44c-b683-4735-a372-2142f240dd27 of volume c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] snapshot_file for this snap is: volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[86281c91-58fd-42ea-9b07-c25ae22e1414]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:53 devstack sudo[107237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 Sep 18 00:52:53 devstack sudo[107237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:53 devstack sudo[107232]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 1073741824" returned: 0 in 0.447s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:53 devstack sudo[107239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 Sep 18 00:52:53 devstack sudo[107239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:53 devstack sudo[107237]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27" returned: 0 in 0.381s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c73c74e7-8ef6-4396-996a-4779bbc8c952(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[4640d33d-5a95-4a57-b0d7-41a2f6b195be]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:53 devstack sudo[107239]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (750ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.754s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab5b1afc-db18-424b-9221-f87a8a740901) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d69b9686-9212-40b8-b14a-85236d9920f5', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf23396c-fd35-47e6-9a14-f64c83fa427a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:52:53 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Volume volume-d69b9686-9212-40b8-b14a-85236d9920f5 (d69b9686-9212-40b8-b14a-85236d9920f5): created successfully Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf23396c-fd35-47e6-9a14-f64c83fa427a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (8f523db1-d1d7-484b-a95e-10a58d65101e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:52:53 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-594b67b1-1525-433d-b6e0-1b3597702c34 tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:52:53 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 Sep 18 00:52:53 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:53 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952" returned: 0 in 0.351s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:53 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:53 devstack sudo[107250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 Sep 18 00:52:53 devstack sudo[107250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:54 devstack sudo[107250]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27" returned: 0 in 0.363s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:54 devstack sudo[107255]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27 Sep 18 00:52:54 devstack sudo[107255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot d026c721-0499-4ec1-97af-8be9ae0a2e97 of volume d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3cd7006-cb1e-4b43-960d-48fa67858a4e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:54 devstack sudo[107255]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952.99d8d44c-b683-4735-a372-2142f240dd27" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-99d8d44c-b683-4735-a372-2142f240dd27" released by "_delete_snapshot" :: held 1.466s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-c73c74e7-8ef6-4396-996a-4779bbc8c952" released by "delete_snapshot" :: held 1.499s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:54 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 Sep 18 00:52:54 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Created reservations ['c1a7986b-7c9a-4e96-a253-08f52148420c', '7216bc0e-35d1-47bf-b2fa-e98680236818', 'e7a11cee-8989-49e9-a144-4aff9cb3ef2f', 'd3d613d6-5dea-49d2-b7db-f461d87bf6d2'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:54 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Delete snapshot completed successfully. Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-36b7d13b-a78a-4571-a47c-4be5d102d6ce tempest-ProjectReaderTests-636043275 None] Lock "cinder-99d8d44c-b683-4735-a372-2142f240dd27-delete_snapshot" released by "delete_snapshot" :: held 1.649s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:54 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:54 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:54 devstack sudo[107264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 1G Sep 18 00:52:54 devstack sudo[107264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-c73c74e7-8ef6-4396-996a-4779bbc8c952-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Lock "cinder-c73c74e7-8ef6-4396-996a-4779bbc8c952-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:55 devstack sudo[107264]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Acquiring lock "cinder-quobyte-c73c74e7-8ef6-4396-996a-4779bbc8c952" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 1G" returned: 0 in 0.439s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69b9686-9212-40b8-b14a-85236d9920f5 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-c73c74e7-8ef6-4396-996a-4779bbc8c952" acquired by "delete_volume" :: waited 0.027s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:55 devstack sudo[107270]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69b9686-9212-40b8-b14a-85236d9920f5 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 Sep 18 00:52:55 devstack sudo[107270]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3b5b222-34eb-417e-8e1a-6952bec3cf99]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:55 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 Sep 18 00:52:55 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:55 devstack sudo[107270]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d69b9686-9212-40b8-b14a-85236d9920f5 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97" returned: 0 in 0.306s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:55 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 is being set with open permissions: ugo+rw Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:55 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 Sep 18 00:52:55 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:55 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952" returned: 0 in 0.382s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:55 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952 Sep 18 00:52:55 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:55 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:55 devstack sudo[107285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.info Sep 18 00:52:55 devstack sudo[107285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:55 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c73c74e7-8ef6-4396-996a-4779bbc8c952" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Lock "cinder-quobyte-c73c74e7-8ef6-4396-996a-4779bbc8c952" released by "delete_volume" :: held 0.713s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:55 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Created reservations ['5ea1d7c9-04e9-48d7-820c-1220b5a682b9', '715d7051-6b3a-4446-a1ea-ef49ee2265be', '0a5e25e0-3e43-4623-b8bc-0b2d93eb30a5', 'ec9ef6f1-74ad-4b0a-8176-cf38868a6b0a'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:56 devstack sudo[107285]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:56 devstack sudo[107289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.info" returned: 0 in 0.276s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:56 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.info is being set with open permissions: ugo+rw Sep 18 00:52:56 devstack sudo[107289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:56 devstack sudo[107291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.info Sep 18 00:52:56 devstack sudo[107291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:56 devstack sudo[107289]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:52:56 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Deleted volume successfully. Sep 18 00:52:56 devstack sudo[107291]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.info" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:52:56 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-faac0b6d-923d-41d0-9ad5-340d82723069 tempest-ProjectReaderTests-636043275 None] Lock "cinder-c73c74e7-8ef6-4396-996a-4779bbc8c952-delete_volume" released by "delete_volume" :: held 1.272s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:56 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cb4d6025-83ef-4a62-86de-6f320ee9e822 tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-d026c721-0499-4ec1-97af-8be9ae0a2e97-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-d026c721-0499-4ec1-97af-8be9ae0a2e97-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-d69b9686-9212-40b8-b14a-85236d9920f5" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d69b9686-9212-40b8-b14a-85236d9920f5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-d026c721-0499-4ec1-97af-8be9ae0a2e97" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d026c721-0499-4ec1-97af-8be9ae0a2e97" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot d026c721-0499-4ec1-97af-8be9ae0a2e97 of volume d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[99809321-f607-4f45-afd6-73da5ef20526]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:57 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:57 devstack sudo[107295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 Sep 18 00:52:57 devstack sudo[107295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:58 devstack sudo[107295]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97" returned: 0 in 0.397s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d69b9686-9212-40b8-b14a-85236d9920f5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9af3528-115f-4cde-89a6-a7a33b212c2e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:58 devstack sudo[107300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 Sep 18 00:52:58 devstack sudo[107300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:58 devstack sudo[107300]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5" returned: 0 in 0.381s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:58 devstack sudo[107305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 Sep 18 00:52:58 devstack sudo[107305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:58 devstack sudo[107305]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97" returned: 0 in 0.354s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:58 devstack sudo[107311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97 Sep 18 00:52:58 devstack sudo[107311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:52:59 devstack sudo[107311]: pam_unix(sudo:session): session closed for user root Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5.d026c721-0499-4ec1-97af-8be9ae0a2e97" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d026c721-0499-4ec1-97af-8be9ae0a2e97" released by "_delete_snapshot" :: held 1.521s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d69b9686-9212-40b8-b14a-85236d9920f5" released by "delete_snapshot" :: held 1.546s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Created reservations ['1c7a89e1-1d9d-4a97-bd4f-58af0bba22c4', '44a97d23-7ea5-4f2a-af10-39b8b0c2ffd2', 'f6947d86-6385-4361-8423-6dd0d372359c', 'abecbe73-f179-4c69-adce-4fa66dc62e01'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:52:59 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-9df5871d-d7cb-4ea4-be85-9d6ea8fc359f tempest-ProjectMemberTests-1382227428 None] Lock "cinder-d026c721-0499-4ec1-97af-8be9ae0a2e97-delete_snapshot" released by "delete_snapshot" :: held 1.685s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-d69b9686-9212-40b8-b14a-85236d9920f5-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-d69b9686-9212-40b8-b14a-85236d9920f5-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-d69b9686-9212-40b8-b14a-85236d9920f5" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d69b9686-9212-40b8-b14a-85236d9920f5" acquired by "delete_volume" :: waited 0.024s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[da4e9417-132e-48b2-9870-597ea89bd3be]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:52:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:52:59 devstack sudo[107314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 Sep 18 00:52:59 devstack sudo[107314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:00 devstack sudo[107314]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5" returned: 0 in 0.376s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:00 devstack sudo[107319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5 Sep 18 00:53:00 devstack sudo[107319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:00 devstack sudo[107319]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d69b9686-9212-40b8-b14a-85236d9920f5" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-d69b9686-9212-40b8-b14a-85236d9920f5" released by "delete_volume" :: held 0.706s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Created reservations ['547cfa60-9fd9-4637-a642-1b9015b9094e', '8ad9386f-bb62-4bc7-8447-606cefd52614', '65a695d4-61e7-4c10-aec5-0cf9bd9d94f5', '4f29fa0f-6c72-42c2-876a-cb8a2afece2e'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:00 devstack sudo[107322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:53:00 devstack sudo[107322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:00 devstack sudo[107322]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.252s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:53:00 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:53:00 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-5afcda81-3e06-467f-a331-d807f9bd4b05 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-d69b9686-9212-40b8-b14a-85236d9920f5-delete_volume" released by "delete_volume" :: held 1.164s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (5eb9ecea-d417-415f-a613-9f22bd8d2b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128bfa6e-7068-4e76-888c-6094052338a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (128bfa6e-7068-4e76-888c-6094052338a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982658266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a81d59-71f9-40ba-9463-b39ab316770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:01Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2a8319-57a5-43ad-b5d3-949a8693235b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3c2a8319-57a5-43ad-b5d3-949a8693235b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c5e2b7-9b6b-4461-8ea7-ad420d20f8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0c5e2b7-9b6b-4461-8ea7-ad420d20f8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '06a81d59-71f9-40ba-9463-b39ab316770a', 'volume_name': 'volume-06a81d59-71f9-40ba-9463-b39ab316770a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ac7938-ef2e-4080-9373-85190bdbf32c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (67ac7938-ef2e-4080-9373-85190bdbf32c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1051dfbb-1501-455c-b4ed-051be06d214c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:01 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Volume 06a81d59-71f9-40ba-9463-b39ab316770a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-06a81d59-71f9-40ba-9463-b39ab316770a', 'volume_size': 1} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1982658266',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=06a81d59-71f9-40ba-9463-b39ab316770a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:01Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Creating volume 06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:01 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:53:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:01 devstack sudo[107327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a 1073741824 Sep 18 00:53:01 devstack sudo[107327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:02 devstack sudo[107327]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a 1073741824" returned: 0 in 0.508s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:02 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a Sep 18 00:53:02 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:02 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.804s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1051dfbb-1501-455c-b4ed-051be06d214c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-06a81d59-71f9-40ba-9463-b39ab316770a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3f2e9f-fc7b-4fd2-8a3d-dda672681cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:02 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Volume volume-06a81d59-71f9-40ba-9463-b39ab316770a (06a81d59-71f9-40ba-9463-b39ab316770a): created successfully Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc3f2e9f-fc7b-4fd2-8a3d-dda672681cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:02 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (5eb9ecea-d417-415f-a613-9f22bd8d2b07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:02 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-888488f4-b3fa-4c81-8df6-2755ef989f00 tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:53:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot 7f55d875-3f2d-446d-847b-c6a3797003a2 of volume 06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:53:03 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8b6830-f5b6-4750-8ee4-888852818e54]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:03 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a Sep 18 00:53:03 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:04 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a" returned: 0 in 0.373s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:04 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 1G Sep 18 00:53:04 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 29 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:53:04 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 1G" returned: 0 in 0.388s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a81d59-71f9-40ba-9463-b39ab316770a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:04 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a81d59-71f9-40ba-9463-b39ab316770a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 Sep 18 00:53:04 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:04 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-06a81d59-71f9-40ba-9463-b39ab316770a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2" returned: 0 in 0.281s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:04 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 is being set with open permissions: ugo+rw Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:04 devstack sudo[107352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 Sep 18 00:53:04 devstack sudo[107352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:04 devstack sudo[107352]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:05 devstack sudo[107355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.info Sep 18 00:53:05 devstack sudo[107355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:05 devstack sudo[107355]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.info" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:05 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.info is being set with open permissions: ugo+rw Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:05 devstack sudo[107358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.info Sep 18 00:53:05 devstack sudo[107358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:05 devstack sudo[107358]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.info" returned: 0 in 0.261s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.919s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:05 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-23e91223-96f2-4e4a-ab04-4d3f3950e026 tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-7f55d875-3f2d-446d-847b-c6a3797003a2-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-7f55d875-3f2d-446d-847b-c6a3797003a2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-06a81d59-71f9-40ba-9463-b39ab316770a" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-06a81d59-71f9-40ba-9463-b39ab316770a" acquired by "delete_snapshot" :: waited 0.022s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-7f55d875-3f2d-446d-847b-c6a3797003a2" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-7f55d875-3f2d-446d-847b-c6a3797003a2" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot 7f55d875-3f2d-446d-847b-c6a3797003a2 of volume 06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[461c5292-149d-4f53-b95f-9df99e07a6b7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:05 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:05 devstack sudo[107361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 Sep 18 00:53:05 devstack sudo[107361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:06 devstack sudo[107361]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2" returned: 0 in 0.430s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:06 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-06a81d59-71f9-40ba-9463-b39ab316770a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:53:06 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0763b9e-19fa-4671-9fef-0823f176b3f3]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:06 devstack sudo[107367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a Sep 18 00:53:06 devstack sudo[107367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:06 devstack sudo[107367]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a" returned: 0 in 0.378s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:06 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:06 devstack sudo[107372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 Sep 18 00:53:06 devstack sudo[107372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:07 devstack sudo[107372]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2" returned: 0 in 0.352s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:07 devstack sudo[107378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2 Sep 18 00:53:07 devstack sudo[107378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:07 devstack sudo[107378]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a.7f55d875-3f2d-446d-847b-c6a3797003a2" returned: 0 in 0.262s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-7f55d875-3f2d-446d-847b-c6a3797003a2" released by "_delete_snapshot" :: held 1.541s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-06a81d59-71f9-40ba-9463-b39ab316770a" released by "delete_snapshot" :: held 1.573s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Created reservations ['12235a14-84e0-4eb8-8b49-5774fee609f4', '01315470-f00d-41c1-b1eb-2c73acaf6bd9', '5504b39e-a259-41d5-80bf-4ebb2c4c6c2b', 'e80c0cf1-19d9-49e9-bd2b-fd92b2c03ad6'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:07 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-a3914324-60c6-4b1a-b924-909476f66086 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-7f55d875-3f2d-446d-847b-c6a3797003a2-delete_snapshot" released by "delete_snapshot" :: held 1.728s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-06a81d59-71f9-40ba-9463-b39ab316770a-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-06a81d59-71f9-40ba-9463-b39ab316770a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-06a81d59-71f9-40ba-9463-b39ab316770a" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:07 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-06a81d59-71f9-40ba-9463-b39ab316770a" acquired by "delete_volume" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[68197f85-9c56-484f-b3f8-5fff6d09cd6e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:08 devstack sudo[107381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a Sep 18 00:53:08 devstack sudo[107381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:08 devstack sudo[107381]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a" returned: 0 in 0.386s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:08 devstack sudo[107386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a Sep 18 00:53:08 devstack sudo[107386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:08 devstack sudo[107386]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-06a81d59-71f9-40ba-9463-b39ab316770a" returned: 0 in 0.308s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-06a81d59-71f9-40ba-9463-b39ab316770a" released by "delete_volume" :: held 0.776s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Created reservations ['7d3b7efe-3fc9-4280-837d-f077828adcea', '27dafc4d-b3a0-4676-9168-3139a5592106', 'd7c2e476-76fe-4a51-bf25-94089345aa3b', 'a4861966-adab-4e52-9ceb-d5dd3547f669'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:08 devstack sudo[107425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:53:08 devstack sudo[107425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (7e232b09-91b1-4fd9-b952-8893d34b1aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:08 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b90b28d-6294-4695-a990-7be722141c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b90b28d-6294-4695-a990-7be722141c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464958828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8852e5-5043-4a9e-b213-e11810959255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:09Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4081c0d-d374-4360-9289-ed0ac0467042) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4081c0d-d374-4360-9289-ed0ac0467042) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb08d941-e3aa-4f2e-8f46-ca5fd6b34915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb08d941-e3aa-4f2e-8f46-ca5fd6b34915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aa8852e5-5043-4a9e-b213-e11810959255', 'volume_name': 'volume-aa8852e5-5043-4a9e-b213-e11810959255', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22841675-e5d5-4c54-898b-fa4a68b5229a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22841675-e5d5-4c54-898b-fa4a68b5229a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c007ee68-5dc9-4ceb-b913-1661e306b1aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Volume aa8852e5-5043-4a9e-b213-e11810959255: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aa8852e5-5043-4a9e-b213-e11810959255', 'volume_size': 1} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-464958828',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa8852e5-5043-4a9e-b213-e11810959255,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:09Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Creating volume aa8852e5-5043-4a9e-b213-e11810959255 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:09 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:09 devstack sudo[107427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 1073741824 Sep 18 00:53:09 devstack sudo[107427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:09 devstack sudo[107425]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.263s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:53:09 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0fd67ec7-daa1-40da-a22a-c0ba4ed4f8a7 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-06a81d59-71f9-40ba-9463-b39ab316770a-delete_volume" released by "delete_volume" :: held 1.271s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:09 devstack sudo[107427]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 1073741824" returned: 0 in 0.496s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (593cd5ac-bba8-4eae-95a1-c67d8d68e9a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58180547-e66e-4ad8-8928-614dfdbce939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58180547-e66e-4ad8-8928-614dfdbce939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347960843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bed8233-4c18-4829-9c4b-73464f4d4c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:10Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c1ca7b-6c47-44d7-bc21-2540f5e22920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33c1ca7b-6c47-44d7-bc21-2540f5e22920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ea581f-05b4-4544-b3fc-08aed237e246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (74ea581f-05b4-4544-b3fc-08aed237e246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7bed8233-4c18-4829-9c4b-73464f4d4c2a', 'volume_name': 'volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d240e42-199f-4919-adff-8d23b4d4cf84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d240e42-199f-4919-adff-8d23b4d4cf84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6346bdb-796f-4006-902e-c0e987188e64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Volume 7bed8233-4c18-4829-9c4b-73464f4d4c2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a', 'volume_size': 1} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:09 devstack sudo[107434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 Sep 18 00:53:09 devstack sudo[107434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:09 devstack sudo[107434]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255" returned: 0 in 0.256s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] <== create_volume: return (872ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.276s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1347960843',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7bed8233-4c18-4829-9c4b-73464f4d4c2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8fae1f78958c4f4dbbad314edca7bd03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:10Z,use_quota=True,user_id='0041033d3d144b00819f4e8d18a8b8e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Creating volume 7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:09 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c007ee68-5dc9-4ceb-b913-1661e306b1aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa8852e5-5043-4a9e-b213-e11810959255', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:09 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f21963-d561-4da0-994e-e0593b76d197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:09 devstack sudo[107437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a 1073741824 Sep 18 00:53:09 devstack sudo[107437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:10 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Volume volume-aa8852e5-5043-4a9e-b213-e11810959255 (aa8852e5-5043-4a9e-b213-e11810959255): created successfully Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6f21963-d561-4da0-994e-e0593b76d197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (7e232b09-91b1-4fd9-b952-8893d34b1aac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:10 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-77f5ffe8-7c31-4a0d-b743-ecc4e9c28f77 tempest-ProjectReaderTests-1252015162 None] Created volume successfully. Sep 18 00:53:10 devstack sudo[107437]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a 1073741824" returned: 0 in 0.424s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:10 devstack sudo[107442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a Sep 18 00:53:10 devstack sudo[107442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:10 devstack sudo[107442]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a" returned: 0 in 0.246s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] <== create_volume: return (707ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.711s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6346bdb-796f-4006-902e-c0e987188e64) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199552d4-3ed6-4c70-b19a-69a089b48501) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:10 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Volume volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a (7bed8233-4c18-4829-9c4b-73464f4d4c2a): created successfully Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (199552d4-3ed6-4c70-b19a-69a089b48501) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:10 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Flow 'volume_create_manager' (593cd5ac-bba8-4eae-95a1-c67d8d68e9a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:11 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ca780916-0799-49da-8134-9b0e1699333f tempest-ProjectMemberTests-1382227428 None] Created volume successfully. Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-aa8852e5-5043-4a9e-b213-e11810959255-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Lock "cinder-aa8852e5-5043-4a9e-b213-e11810959255-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-quobyte-aa8852e5-5043-4a9e-b213-e11810959255" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-aa8852e5-5043-4a9e-b213-e11810959255" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[9531c04c-278c-4e22-a43c-e28cab040c8d]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:11 devstack sudo[107447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 Sep 18 00:53:11 devstack sudo[107447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:11 devstack sudo[107447]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255" returned: 0 in 0.378s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:11 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:11 devstack sudo[107452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255 Sep 18 00:53:11 devstack sudo[107452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:12 devstack sudo[107452]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-aa8852e5-5043-4a9e-b213-e11810959255" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-aa8852e5-5043-4a9e-b213-e11810959255" released by "delete_volume" :: held 0.677s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Created reservations ['a7e2e6c0-57db-4786-9c6b-3990fdf71fbd', 'bac9724c-65b4-47eb-916e-d4ccca7ad45a', '0fa69e0a-536e-48cc-81a8-4bd3b2b3d402', 'c08af0c6-7c26-4854-ac6a-62d1f96d15c1'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Creating offline snapshot 25096a6d-b494-40b7-97d2-bb25eaf545c1 of volume 7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e6278e3-f7c1-4a46-aa31-c185ec8032f7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:12 devstack sudo[107455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a Sep 18 00:53:12 devstack sudo[107455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:12 devstack sudo[107457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:53:12 devstack sudo[107457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:12 devstack sudo[107455]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a" returned: 0 in 0.370s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:12 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:12 devstack sudo[107462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 1G Sep 18 00:53:12 devstack sudo[107462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:13 devstack sudo[107457]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.266s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:53:13 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Deleted volume successfully. Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f0377042-4f7d-43dd-ab67-6867028987bc tempest-ProjectReaderTests-1252015162 None] Lock "cinder-aa8852e5-5043-4a9e-b213-e11810959255-delete_volume" released by "delete_volume" :: held 1.809s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:13 devstack sudo[107462]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 1G" returned: 0 in 0.425s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:13 devstack sudo[107468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 Sep 18 00:53:13 devstack sudo[107468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:13 devstack sudo[107468]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1" returned: 0 in 0.301s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:13 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 is being set with open permissions: ugo+rw Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:13 devstack sudo[107473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 Sep 18 00:53:13 devstack sudo[107473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:13 devstack sudo[107473]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1" returned: 0 in 0.248s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:13 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=255,cinder:SELECT=194,cinder:INSERT=67,cinder:DELETE=19 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:14 devstack sudo[107482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.info Sep 18 00:53:14 devstack sudo[107482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:14 devstack sudo[107482]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.info" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:14 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.info is being set with open permissions: ugo+rw Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:14 devstack sudo[107485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.info Sep 18 00:53:14 devstack sudo[107485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=185,cinder:INSERT=70,cinder:UPDATE=245,cinder:DELETE=21 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:53:14 devstack sudo[107485]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.info" returned: 0 in 0.257s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.082s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (2b3274a9-883a-4c09-b5e0-135bd4c55ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac9b7e1-70ca-416a-8472-ae31d67feba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:14 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-a41dbacf-967c-44d8-b7c1-1fbcf76dda12 tempest-ProjectMemberTests-1382227428 None] Create snapshot completed successfully Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3ac9b7e1-70ca-416a-8472-ae31d67feba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36798141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ce68be-8cd5-439e-ac3d-0160d7dc9a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:14Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eafb0d-c030-422d-922b-e850e2e1c0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9eafb0d-c030-422d-922b-e850e2e1c0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2922e2b2-3a01-4b2a-bfb4-308e50a63957) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2922e2b2-3a01-4b2a-bfb4-308e50a63957) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3ce68be-8cd5-439e-ac3d-0160d7dc9a72', 'volume_name': 'volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f43b8b7-d71e-4115-b172-9db47b1201a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f43b8b7-d71e-4115-b172-9db47b1201a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398bdc85-ec6e-4d74-a816-c867c94d3d44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:14 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Volume c3ce68be-8cd5-439e-ac3d-0160d7dc9a72: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72', 'volume_size': 1} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-36798141',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3ce68be-8cd5-439e-ac3d-0160d7dc9a72,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:14Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Creating volume c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:14 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:53:14 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:14 devstack sudo[107488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 1073741824 Sep 18 00:53:14 devstack sudo[107488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:15 devstack sudo[107488]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 1073741824" returned: 0 in 0.419s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:15 devstack sudo[107494]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 Sep 18 00:53:15 devstack sudo[107494]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:15 devstack sudo[107494]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72" returned: 0 in 0.260s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] <== create_volume: return (884ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.887s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (398bdc85-ec6e-4d74-a816-c867c94d3d44) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20c89d9-60ef-4a4c-aec0-6655c8b0a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:15 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Volume volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 (c3ce68be-8cd5-439e-ac3d-0160d7dc9a72): created successfully Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a20c89d9-60ef-4a4c-aec0-6655c8b0a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:15 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (2b3274a9-883a-4c09-b5e0-135bd4c55ca2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:15 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-88bffb08-9f59-448f-bfee-0900fa47cbbd tempest-ProjectReaderTests-1252015162 None] Created volume successfully. Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-25096a6d-b494-40b7-97d2-bb25eaf545c1-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Lock "cinder-25096a6d-b494-40b7-97d2-bb25eaf545c1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-7bed8233-4c18-4829-9c4b-73464f4d4c2a" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-7bed8233-4c18-4829-9c4b-73464f4d4c2a" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-25096a6d-b494-40b7-97d2-bb25eaf545c1" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-25096a6d-b494-40b7-97d2-bb25eaf545c1" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Deleting offline snapshot 25096a6d-b494-40b7-97d2-bb25eaf545c1 of volume 7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] snapshot_file for this snap is: volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[f7577c05-f361-4551-b5a2-ca5e5e5a1af7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:16 devstack sudo[107497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 Sep 18 00:53:16 devstack sudo[107497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Lock "cinder-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-quobyte-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:16 devstack sudo[107497]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1" returned: 0 in 0.407s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72" acquired by "delete_volume" :: waited 0.036s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[60b184d5-9952-405f-b9fd-dee41d703203]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc1cfe6-9898-405c-bc79-d9dcd14a140c]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:16 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:16 devstack sudo[107503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a Sep 18 00:53:16 devstack sudo[107503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:16 devstack sudo[107504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 Sep 18 00:53:16 devstack sudo[107504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:17 devstack sudo[107503]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a" returned: 0 in 0.378s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:17 devstack sudo[107504]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72" returned: 0 in 0.384s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:17 devstack sudo[107513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 Sep 18 00:53:17 devstack sudo[107513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:17 devstack sudo[107515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72 Sep 18 00:53:17 devstack sudo[107515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:17 devstack sudo[107515]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72" returned: 0 in 0.254s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72" released by "delete_volume" :: held 0.687s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Created reservations ['04d20849-e7a1-4e6f-80ce-2494b9de9427', '39758f65-44e2-4986-b9b8-de4c2102eff9', '534706e1-3f2d-4eb8-a06d-13449436d8db', '8e7ab538-651c-4417-ad75-f28a91787f89'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:17 devstack sudo[107513]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1" returned: 0 in 0.365s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:17 devstack sudo[107521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1 Sep 18 00:53:17 devstack sudo[107521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:17 devstack sudo[107523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:53:17 devstack sudo[107523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:17 devstack sudo[107521]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a.25096a6d-b494-40b7-97d2-bb25eaf545c1" returned: 0 in 0.267s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-25096a6d-b494-40b7-97d2-bb25eaf545c1" released by "_delete_snapshot" :: held 1.524s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-7bed8233-4c18-4829-9c4b-73464f4d4c2a" released by "delete_snapshot" :: held 1.549s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:17 devstack sudo[107523]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.264s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:53:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Deleted volume successfully. Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ba6f75b0-522d-4927-b495-bb599ce907ea tempest-ProjectReaderTests-1252015162 None] Lock "cinder-c3ce68be-8cd5-439e-ac3d-0160d7dc9a72-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Created reservations ['6a02ffa7-1545-40f5-9c5e-51017399563d', '97a782c5-2440-4288-b883-0a385fa04026', '0baaef20-1992-4e04-9a00-418db900f779', '3fa9a6fc-f7ab-4713-ba06-3625b46cd734'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:17 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Delete snapshot completed successfully. Sep 18 00:53:17 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-64125430-3f7d-4b5e-8c46-8a6b65808b7b tempest-ProjectMemberTests-1382227428 None] Lock "cinder-25096a6d-b494-40b7-97d2-bb25eaf545c1-delete_snapshot" released by "delete_snapshot" :: held 1.708s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (4320d6da-9bc3-4e01-b319-accd6a1f7643) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afead8e3-155f-45d1-ab30-bd192d2e2899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (afead8e3-155f-45d1-ab30-bd192d2e2899) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-316633758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d440e8f4-c835-4905-979c-942b6b3da804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:18Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d46c0a-46d6-49a1-9d41-e5ce5cb3abff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40d46c0a-46d6-49a1-9d41-e5ce5cb3abff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e1a0ed-4bea-4f73-b88b-d2dda59942e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1e1a0ed-4bea-4f73-b88b-d2dda59942e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd440e8f4-c835-4905-979c-942b6b3da804', 'volume_name': 'volume-d440e8f4-c835-4905-979c-942b6b3da804', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401528e8-b21d-4332-8689-035b95375416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (401528e8-b21d-4332-8689-035b95375416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98478f56-f953-464c-892d-45092f2b14f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:18 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Volume d440e8f4-c835-4905-979c-942b6b3da804: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d440e8f4-c835-4905-979c-942b6b3da804', 'volume_size': 1} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-316633758',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d440e8f4-c835-4905-979c-942b6b3da804,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:18Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Creating volume d440e8f4-c835-4905-979c-942b6b3da804 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:18 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-7bed8233-4c18-4829-9c4b-73464f4d4c2a-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:18 devstack sudo[107527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 1073741824 Sep 18 00:53:18 devstack sudo[107527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-7bed8233-4c18-4829-9c4b-73464f4d4c2a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "cinder-quobyte-7bed8233-4c18-4829-9c4b-73464f4d4c2a" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-7bed8233-4c18-4829-9c4b-73464f4d4c2a" acquired by "delete_volume" :: waited 0.023s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[295ac7b7-20ed-463f-8cb6-660d499a1d9f]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:18 devstack sudo[107529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a Sep 18 00:53:18 devstack sudo[107529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:18 devstack sudo[107527]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 1073741824" returned: 0 in 0.459s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:18 devstack sudo[107536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 Sep 18 00:53:18 devstack sudo[107536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:18 devstack sudo[107529]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a" returned: 0 in 0.420s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:18 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:18 devstack sudo[107540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a Sep 18 00:53:18 devstack sudo[107540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:19 devstack sudo[107536]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804" returned: 0 in 0.275s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] <== create_volume: return (779ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.782s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98478f56-f953-464c-892d-45092f2b14f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d440e8f4-c835-4905-979c-942b6b3da804', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ff4226-f117-441e-b039-f5e7b8cda2fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:19 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Volume volume-d440e8f4-c835-4905-979c-942b6b3da804 (d440e8f4-c835-4905-979c-942b6b3da804): created successfully Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (86ff4226-f117-441e-b039-f5e7b8cda2fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (4320d6da-9bc3-4e01-b319-accd6a1f7643) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-e25c4769-6015-40ab-adf0-6270f0de068e tempest-ProjectReaderTests-1252015162 None] Created volume successfully. Sep 18 00:53:19 devstack sudo[107540]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-7bed8233-4c18-4829-9c4b-73464f4d4c2a" returned: 0 in 0.248s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-quobyte-7bed8233-4c18-4829-9c4b-73464f4d4c2a" released by "delete_volume" :: held 0.733s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Created reservations ['1a536fa3-ecd1-4652-a96b-e7f8e9db5ddb', 'bb3dbe0f-dc49-4c62-b9a5-01391ea04578', '32bb0e07-8760-47a9-ae9d-35a43f809662', '07675c59-b7da-4007-b1d5-4e7e0e7f3d1f'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:19 devstack sudo[107544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:53:19 devstack sudo[107544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-d440e8f4-c835-4905-979c-942b6b3da804-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-d440e8f4-c835-4905-979c-942b6b3da804-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-quobyte-d440e8f4-c835-4905-979c-942b6b3da804" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-d440e8f4-c835-4905-979c-942b6b3da804" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e735414a-08c3-4f7f-b34b-55d57f8e60df]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:19 devstack sudo[107544]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:53:19 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Deleted volume successfully. Sep 18 00:53:19 devstack sudo[107546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-0e199e7b-2878-412a-968c-3f6223985f79 tempest-ProjectMemberTests-1382227428 None] Lock "cinder-7bed8233-4c18-4829-9c4b-73464f4d4c2a-delete_volume" released by "delete_volume" :: held 1.223s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:19 devstack sudo[107546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:19 devstack sudo[107546]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804" returned: 0 in 0.388s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:19 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:19 devstack sudo[107552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804 Sep 18 00:53:19 devstack sudo[107552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:20 devstack sudo[107552]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-d440e8f4-c835-4905-979c-942b6b3da804" returned: 0 in 0.259s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-d440e8f4-c835-4905-979c-942b6b3da804" released by "delete_volume" :: held 0.702s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Created reservations ['9b328d86-275e-4745-bc54-e5150e112655', 'f3b8ed45-1586-46d0-8d1f-6f50e8afd099', 'aae2398e-e642-43db-a652-0e8abaf82b76', '56790092-b016-49e4-ba9a-5578751638fa'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:20 devstack sudo[107555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:53:20 devstack sudo[107555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:20 devstack sudo[107555]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.273s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:53:20 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Deleted volume successfully. Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-ef4f2963-7d2d-453b-bfd9-cb1774378052 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-d440e8f4-c835-4905-979c-942b6b3da804-delete_volume" released by "delete_volume" :: held 1.189s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (bf647265-2b53-40c7-8332-3f0c7a6ee9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:20 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb81a354-b0f4-46c0-bb83-bd13375306d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb81a354-b0f4-46c0-bb83-bd13375306d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538671683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48679d03-5861-4f85-ba17-8a25c1765984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:21Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7156b4f-ecc1-426a-b443-536c0b8c5630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7156b4f-ecc1-426a-b443-536c0b8c5630) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f61c4b-ca29-49a1-ba96-2a12e599bcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4f61c4b-ca29-49a1-ba96-2a12e599bcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48679d03-5861-4f85-ba17-8a25c1765984', 'volume_name': 'volume-48679d03-5861-4f85-ba17-8a25c1765984', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e010e6-8cc3-4c7b-846e-27aa0f0f1b6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31e010e6-8cc3-4c7b-846e-27aa0f0f1b6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556fbe4a-110e-4271-b0c2-35759ea204a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Volume 48679d03-5861-4f85-ba17-8a25c1765984: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48679d03-5861-4f85-ba17-8a25c1765984', 'volume_size': 1} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1538671683',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48679d03-5861-4f85-ba17-8a25c1765984,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1a742a3e9fb94ae281df9517d785cfa1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:21Z,use_quota=True,user_id='ec6820996ea44b2bb2b101527feb27d2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Creating volume 48679d03-5861-4f85-ba17-8a25c1765984 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:21 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:21 devstack sudo[107558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 1073741824 Sep 18 00:53:21 devstack sudo[107558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:21 devstack sudo[107558]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 1073741824" returned: 0 in 0.455s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:21 devstack sudo[107565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 Sep 18 00:53:21 devstack sudo[107565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:21 devstack sudo[107565]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984" returned: 0 in 0.271s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] <== create_volume: return (771ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.774s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (556fbe4a-110e-4271-b0c2-35759ea204a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48679d03-5861-4f85-ba17-8a25c1765984', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20ce0db-4fc1-488e-9258-f49169f98c0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:21 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Volume volume-48679d03-5861-4f85-ba17-8a25c1765984 (48679d03-5861-4f85-ba17-8a25c1765984): created successfully Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20ce0db-4fc1-488e-9258-f49169f98c0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:21 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Flow 'volume_create_manager' (bf647265-2b53-40c7-8332-3f0c7a6ee9d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:21 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-fc554343-4e20-44d3-b1cc-c43113a9e8f0 tempest-ProjectReaderTests-1252015162 None] Created volume successfully. Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-48679d03-5861-4f85-ba17-8a25c1765984-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-48679d03-5861-4f85-ba17-8a25c1765984-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "cinder-quobyte-48679d03-5861-4f85-ba17-8a25c1765984" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-48679d03-5861-4f85-ba17-8a25c1765984" acquired by "delete_volume" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[2854d209-801d-4da1-8db7-f035f650dd15]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:23 devstack sudo[107568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 Sep 18 00:53:23 devstack sudo[107568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:23 devstack sudo[107568]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984" returned: 0 in 0.372s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:23 devstack sudo[107573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984 Sep 18 00:53:23 devstack sudo[107573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:23 devstack sudo[107573]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-48679d03-5861-4f85-ba17-8a25c1765984" returned: 0 in 0.258s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-quobyte-48679d03-5861-4f85-ba17-8a25c1765984" released by "delete_volume" :: held 0.671s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Created reservations ['0b55254b-830b-454c-b5df-0f6ee6bcb64e', '390b3bfd-f4d7-4d2c-94ce-30fa8f85ff5b', '6070dd8a-68f4-4d7a-a139-b98fec4e6a68', 'a9512269-cee1-4dc2-a23b-cc3ae6c6e4c8'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:23 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:23 devstack sudo[107576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:53:23 devstack sudo[107576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:24 devstack sudo[107576]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:24 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.274s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:24 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:53:24 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Deleted volume successfully. Sep 18 00:53:24 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-f48e6d13-21e7-4109-866f-2511ecb049c6 tempest-ProjectReaderTests-1252015162 None] Lock "cinder-48679d03-5861-4f85-ba17-8a25c1765984-delete_volume" released by "delete_volume" :: held 1.150s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:33 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:UPDATE=51,cinder:SELECT=34,cinder:DELETE=3,cinder:INSERT=13 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:53:34 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:INSERT=10,cinder:UPDATE=43,cinder:SELECT=27,cinder:DELETE=5 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Flow 'volume_create_manager' (447ba1db-733c-4c12-b16c-57a19260bc7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f65184-bca6-4bb3-a32e-5edcbcc24c7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f2f65184-bca6-4bb3-a32e-5edcbcc24c7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-553163463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d4a3b8-060a-4b61-9047-4773aac536e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8f3ce402564ab0a53bcef278a74115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:48Z,use_quota=True,user_id='b7d5a448b616417ab82a4a52507862b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fca716-ea0b-4291-be17-f004775834f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76fca716-ea0b-4291-be17-f004775834f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168883e1-9021-4449-92b9-f0bb3d52bdf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (168883e1-9021-4449-92b9-f0bb3d52bdf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0d4a3b8-060a-4b61-9047-4773aac536e4', 'volume_name': 'volume-a0d4a3b8-060a-4b61-9047-4773aac536e4', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c282daff-e6fa-4571-8213-a3f667a140d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c282daff-e6fa-4571-8213-a3f667a140d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2bd7e8-a7cd-41b4-886b-01e8d920e389) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:48 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Volume a0d4a3b8-060a-4b61-9047-4773aac536e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0d4a3b8-060a-4b61-9047-4773aac536e4', 'volume_size': 1} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-553163463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0d4a3b8-060a-4b61-9047-4773aac536e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8f3ce402564ab0a53bcef278a74115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:48Z,use_quota=True,user_id='b7d5a448b616417ab82a4a52507862b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)}" {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Creating volume a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:48 devstack cinder-volume[86526]: INFO cinder.volume.drivers.remotefs [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] casted to osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 1073741824 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:48 devstack sudo[107585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 1073741824 Sep 18 00:53:48 devstack sudo[107585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:48 devstack sudo[107585]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 1073741824" returned: 0 in 0.410s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:48 devstack sudo[107590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 Sep 18 00:53:48 devstack sudo[107590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:48 devstack sudo[107590]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4" returned: 0 in 0.244s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'} {{(pid=86526) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa2bd7e8-a7cd-41b4-886b-01e8d920e389) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0d4a3b8-060a-4b61-9047-4773aac536e4', 'volume_size': 1}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170d1a18-2ce6-4275-a8ad-c6ea681ad173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:48 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Volume volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 (a0d4a3b8-060a-4b61-9047-4773aac536e4): created successfully Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (170d1a18-2ce6-4275-a8ad-c6ea681ad173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:48 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Flow 'volume_create_manager' (447ba1db-733c-4c12-b16c-57a19260bc7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:48 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-1116b65f-ffaf-4cdf-83ca-b5bb1fe96b16 tempest-SnapshotDependencyTests-354602346 None] Created volume successfully. Sep 18 00:53:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:49 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Creating offline snapshot 2ccafcf8-e845-4f40-bdee-ed747fecff79 of volume a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 18 00:53:49 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb86237c-5147-40f0-9e52-1c9c866ac422]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:49 devstack sudo[107593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 Sep 18 00:53:49 devstack sudo[107593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:49 devstack sudo[107593]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4" returned: 0 in 0.356s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:49 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 1G {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:49 devstack sudo[107598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 1G Sep 18 00:53:49 devstack sudo[107598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:50 devstack sudo[107598]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 1G" returned: 0 in 0.391s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:50 devstack sudo[107604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 Sep 18 00:53:50 devstack sudo[107604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:50 devstack sudo[107604]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 -F qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79" returned: 0 in 0.284s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:50 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 is being set with open permissions: ugo+rw Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:50 devstack sudo[107609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 Sep 18 00:53:50 devstack sudo[107609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:50 devstack sudo[107609]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:50 devstack sudo[107612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.info Sep 18 00:53:50 devstack sudo[107612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:50 devstack sudo[107612]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.info" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:50 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.info is being set with open permissions: ugo+rw Sep 18 00:53:50 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.info {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:50 devstack sudo[107615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.info Sep 18 00:53:50 devstack sudo[107615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:51 devstack sudo[107615]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.info" returned: 0 in 0.249s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.865s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:51 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cd47f18c-f90b-487b-8101-5cb2eaf297f1 tempest-SnapshotDependencyTests-354602346 None] Create snapshot completed successfully Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86526) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Flow 'volume_create_manager' (c063b53c-27d3-4095-8567-04c8c2c53951) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68f384-109e-4c74-b14d-963674e56c49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5f68f384-109e-4c74-b14d-963674e56c49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-17T22:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d8f3ce402564ab0a53bcef278a74115',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-17T22:53:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=2ccafcf8-e845-4f40-bdee-ed747fecff79,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-17T22:53:52Z,use_quota=True,user_id='b7d5a448b616417ab82a4a52507862b1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(091afa07-3325-475a-8462-dfe1bf2da0ac),volume_type_id=091afa07-3325-475a-8462-dfe1bf2da0ac)' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef69b6a-0cdc-4a03-ad3c-325a7bd4cd6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fef69b6a-0cdc-4a03-ad3c-325a7bd4cd6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c077969e-b886-4cb8-8b2b-691ee87b2b82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c077969e-b886-4cb8-8b2b-691ee87b2b82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c', 'volume_name': 'volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c', 'volume_size': 1, 'snapshot_id': '2ccafcf8-e845-4f40-bdee-ed747fecff79'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:51 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b297cc05-b4b4-468e-959e-70fd33a84695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b297cc05-b4b4-468e-959e-70fd33a84695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292b9ccf-e6f5-4d9c-90b4-ed8e8289b3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:52 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Volume 6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c', 'volume_size': 1, 'snapshot_id': '2ccafcf8-e845-4f40-bdee-ed747fecff79'} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-quobyte-2ccafcf8-e845-4f40-bdee-ed747fecff79-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" by "_create_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-2ccafcf8-e845-4f40-bdee-ed747fecff79-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Creating volume 6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c from snapshot 2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Selected osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa as target Quobyte volume. {{(pid=86526) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-quobyte-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" by "_copy_volume_from_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" acquired by "_copy_volume_from_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] snapshot: 2ccafcf8-e845-4f40-bdee-ed747fecff79, volume: 6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c, {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[b25cc071-9a81-49b7-8d46-9aef4d39c9a9]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:52 devstack sudo[107619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 Sep 18 00:53:52 devstack sudo[107619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:52 devstack sudo[107619]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79" returned: 0 in 0.354s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d4a3b8-060a-4b61-9047-4773aac536e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6cd5cc7-8e05-479b-b889-3ec144312556]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:52 devstack sudo[107624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 Sep 18 00:53:52 devstack sudo[107624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:52 devstack sudo[107624]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4" returned: 0 in 0.368s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] will copy from snapshot at /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Creating direct copy from snapshot {{(pid=86526) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG cinder.utils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Path /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c not found in is_blk_device check {{(pid=86526) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 18 00:53:52 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:52 devstack sudo[107629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c Sep 18 00:53:52 devstack sudo[107629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:58 devstack sudo[107629]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" returned: 0 in 5.883s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:58 devstack cinder-volume[86526]: DEBUG cinder.image.image_utils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Image conversion details: src /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4, size 1024.00 MB, duration 5.88 sec, destination /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c {{(pid=86526) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Sep 18 00:53:58 devstack cinder-volume[86526]: INFO cinder.image.image_utils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Converted 1024.00 MB image at 174.01 MB/s Sep 18 00:53:58 devstack cinder-volume[86526]: WARNING cinder.volume.drivers.remotefs [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c is being set with open permissions: ugo+rw Sep 18 00:53:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:58 devstack sudo[107642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c Sep 18 00:53:58 devstack sudo[107642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:53:58 devstack sudo[107642]: pam_unix(sudo:session): session closed for user root Sep 18 00:53:58 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" returned: 0 in 0.236s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:53:58 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" released by "_copy_volume_from_snapshot" :: held 6.921s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-2ccafcf8-e845-4f40-bdee-ed747fecff79-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" released by "_create_volume_from_snapshot" :: held 6.982s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (292b9ccf-e6f5-4d9c-90b4-ed8e8289b3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c', 'volume_size': 1, 'snapshot_id': '2ccafcf8-e845-4f40-bdee-ed747fecff79'}' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c1bdbd-e667-4da2-81ea-897020451d8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 18 00:53:59 devstack cinder-volume[86526]: INFO cinder.volume.flows.manager.create_volume [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Volume volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c (6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c): created successfully Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5c1bdbd-e667-4da2-81ea-897020451d8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86526) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Flow 'volume_create_manager' (c063b53c-27d3-4095-8567-04c8c2c53951) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86526) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 18 00:53:59 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-aa9cf1b5-f994-4d39-ad6b-5b6b4a6a3e50 tempest-SnapshotDependencyTests-354602346 None] Created volume successfully. Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-2ccafcf8-e845-4f40-bdee-ed747fecff79-delete_snapshot" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-2ccafcf8-e845-4f40-bdee-ed747fecff79-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-quobyte-a0d4a3b8-060a-4b61-9047-4773aac536e4" by "delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-a0d4a3b8-060a-4b61-9047-4773aac536e4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-quobyte-2ccafcf8-e845-4f40-bdee-ed747fecff79" by "_delete_snapshot" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-2ccafcf8-e845-4f40-bdee-ed747fecff79" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Deleting offline snapshot 2ccafcf8-e845-4f40-bdee-ed747fecff79 of volume a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] snapshot_file for this snap is: volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fb36510-1ccc-48cb-87af-40b3f2bd80db]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:53:59 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:53:59 devstack sudo[107645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 Sep 18 00:53:59 devstack sudo[107645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:00 devstack sudo[107645]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79" returned: 0 in 0.354s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.remotefs [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a0d4a3b8-060a-4b61-9047-4773aac536e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86526) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0309c8f0-90c5-4f62-9e09-9509976bd0a7]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:00 devstack sudo[107650]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 Sep 18 00:54:00 devstack sudo[107650]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:00 devstack sudo[107650]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4" returned: 0 in 0.532s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:00 devstack sudo[107655]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 Sep 18 00:54:00 devstack sudo[107655]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:00 devstack sudo[107655]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79" returned: 0 in 0.323s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:00 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:00 devstack sudo[107661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79 Sep 18 00:54:00 devstack sudo[107661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:01 devstack sudo[107661]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4.2ccafcf8-e845-4f40-bdee-ed747fecff79" returned: 0 in 0.252s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-2ccafcf8-e845-4f40-bdee-ed747fecff79" released by "_delete_snapshot" :: held 1.565s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-a0d4a3b8-060a-4b61-9047-4773aac536e4" released by "delete_snapshot" :: held 1.586s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Created reservations ['81ea3116-55ac-4375-a60b-985cf7dee591', '3bb4c47c-bf29-46d1-a761-be05e0cc3e9d', '79cbc957-5fd9-4f99-a700-6ee7ef97034c', 'e46ff601-d2fd-4ec7-a42a-426b684d07d8'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:54:01 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Delete snapshot completed successfully. Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-286228a2-64ce-460c-ab4f-5a9ca7f221aa tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-2ccafcf8-e845-4f40-bdee-ed747fecff79-delete_snapshot" released by "delete_snapshot" :: held 1.735s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-a0d4a3b8-060a-4b61-9047-4773aac536e4-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-a0d4a3b8-060a-4b61-9047-4773aac536e4-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-quobyte-a0d4a3b8-060a-4b61-9047-4773aac536e4" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-a0d4a3b8-060a-4b61-9047-4773aac536e4" acquired by "delete_volume" :: waited 0.013s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[3310e222-e10a-4115-8fad-0e97b9e8a745]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:54:01 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:01 devstack sudo[107666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 Sep 18 00:54:01 devstack sudo[107666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:02 devstack sudo[107666]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4" returned: 0 in 0.357s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:02 devstack sudo[107671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4 Sep 18 00:54:02 devstack sudo[107671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:02 devstack sudo[107671]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-a0d4a3b8-060a-4b61-9047-4773aac536e4" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-a0d4a3b8-060a-4b61-9047-4773aac536e4" released by "delete_volume" :: held 0.665s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Created reservations ['164cb464-6cce-48f3-9ac4-bd8e14ba8df2', '65ab34aa-d00a-4540-82a2-2a059c8c7dfd', '5dd4eed0-15c4-43a1-96ab-64e60a559eb1', 'c2531e4c-46f1-452e-a050-1641306bfa6d'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:02 devstack sudo[107674]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:54:02 devstack sudo[107674]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:02 devstack sudo[107674]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.247s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:54:02 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Deleted volume successfully. Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-db80ec30-b84b-496e-844c-af8dce8c9d36 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-a0d4a3b8-060a-4b61-9047-4773aac536e4-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c-delete_volume" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "cinder-quobyte-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" by "delete_volume" {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" acquired by "delete_volume" :: waited 0.015s {{(pid=86526) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e746ceb-f012-494c-b67f-901e72a7f12e]: (4, 'qcow2') {{(pid=87608) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 18 00:54:02 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:03 devstack sudo[107677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c Sep 18 00:54:03 devstack sudo[107677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:03 devstack sudo[107677]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" returned: 0 in 0.359s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:03 devstack sudo[107682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c Sep 18 00:54:03 devstack sudo[107682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:03 devstack sudo[107682]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb/volume-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" returned: 0 in 0.251s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-quobyte-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c" released by "delete_volume" :: held 0.651s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG cinder.quota [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Created reservations ['c48c813d-bff1-4671-880e-5f634c3bb6cf', 'd12b2293-7f3b-4177-9b53-73878f47f3fd', '3cd770f5-084d-4f04-90f0-f5628a1df674', '26d3ebd9-7e25-4dfd-bb69-f4529eb5dc71'] {{(pid=86526) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:03 devstack sudo[107685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:54:03 devstack sudo[107685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:03 devstack sudo[107685]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.241s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:54:03 devstack cinder-volume[86526]: INFO cinder.volume.manager [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Deleted volume successfully. Sep 18 00:54:03 devstack cinder-volume[86526]: DEBUG cinder.coordination [None req-cbafac4a-4db9-4aaf-a2a9-c3f9e5d0c604 tempest-SnapshotDependencyTests-354602346 None] Lock "cinder-6c7fa5ec-9961-4ba1-9b4a-1ebcdbd5eb6c-delete_volume" released by "delete_volume" :: held 1.083s {{(pid=86526) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa': None} {{(pid=86526) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG cinder.volume.drivers.quobyte [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-29b8c723-8803-41e4-9c95-8cf7244ceafa'] {{(pid=86526) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.lockutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86526) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 18 00:54:04 devstack sudo[107688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb Sep 18 00:54:04 devstack sudo[107688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 18 00:54:04 devstack sudo[107688]: pam_unix(sudo:session): session closed for user root Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG oslo_concurrency.processutils [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/ff3c47946d83fa3d79bf878eb96b17fb" returned: 0 in 0.250s {{(pid=86526) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG cinder.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Notifying Schedulers of capabilities ... {{(pid=86526) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG oslo_service.periodic_task [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] Running periodic task VolumeManager._thread_info {{(pid=86526) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread count: 29 {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 18 00:54:04 devstack cinder-volume[86526]: DEBUG cinder.volume.manager [None req-5583339d-1253-4cb2-bb7b-3f159e679ce9 None None] thread info: [<_MainThread(MainThread, started 123757122519168)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86526) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 18 00:54:13 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=26,cinder:UPDATE=28,cinder:INSERT=6,cinder:DELETE=1 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 18 00:54:13 devstack cinder-volume[86526]: DEBUG dbcounter [-] [86526] Writing DB stats cinder:SELECT=24,cinder:UPDATE=31,cinder:INSERT=9,cinder:DELETE=4 {{(pid=86526) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}